Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........................X..........X...X....................] duration: 1.574516368s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:52:56 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.574543577s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X....X........X...............] duration: 848.077394ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:52:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 848.162843ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........................X..........X...X...................] duration: 1.704370286s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:52:39 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.704397616s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.........................X......X.X.X.XX..XX.X..............] duration: 276.118988ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:52:25 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 276.147475ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.428566079s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:52:22 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.428600376s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 2.287648044s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:52:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.287703118s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...........X.....................] duration: 1.161561225s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:52:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.161578102s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 2.424531011s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:52:11 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.424606777s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...........X....................] duration: 904.737917ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:51:37 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 904.765655ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 2.342500239s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:51:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.342532169s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X....X........X..............] duration: 987.89072ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:51:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 987.92315ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..........................X..........X...X..................] duration: 1.614575129s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:51:25 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.614603539s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [..........................X......X.X.X.XX..XX.X.............] duration: 265.646189ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:51:11 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 265.672469ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.295419257s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:51:09 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.295447447s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X...........X...................] duration: 948.571168ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:51:02 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 948.601925ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 3.020213855s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:50:59 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.020249377s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X...........X..................] duration: 1.173127111s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:50:43 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.173155157s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 2.176032599s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:50:39 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.176062031s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...........................X..........X...X.................] duration: 2.091442604s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:50:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.091470232s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 2.402301671s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:50:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.402329408s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X....X........X.............] duration: 932.408612ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:50:32 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 932.438088ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [...........................X......X.X.X.XX..XX.X............] duration: 290.465049ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:50:24 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 290.490515ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.512508053s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:50:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.512533622s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X...........X.................] duration: 902.855524ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:50:15 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 902.881165ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 2.613015108s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:50:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.613044627s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 2.333944669s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:49:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.33397502s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X....X........X............] duration: 860.573489ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:49:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 860.613174ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.363092033s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:49:39 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.363116851s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [............................X..........X...X................] duration: 1.706708518s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:49:32 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.706733339s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [............................X......X.X.X.XX..XX.X...........] duration: 276.24233ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:49:16 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 276.27283ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X...........X................] duration: 1.077440631s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:49:10 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.077468275s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.............................X..........X...X...............] duration: 2.146692441s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:49:05 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.146772867s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 2.33772007s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:49:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.337752959s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.280779728s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:48:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.280806995s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............................X..........X...X..............] duration: 1.623694588s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:48:46 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.62371561s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.............................X......X.X.X.XX..XX.X..........] duration: 288.138053ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:48:42 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 288.1672ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X....X........X...........] duration: 932.637402ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:48:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 932.67115ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 2.360466868s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:48:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.360497455s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...............................X..........X...X.............] duration: 1.91816511s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:48:28 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.918190533s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X...........X...............] duration: 935.956133ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:48:27 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 935.994698ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 2.515741211s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:48:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.515769411s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X....X........X..........] duration: 1.091476055s trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:48:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.09150228s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 2.505511821s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:48:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.505627099s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 2.408585968s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:47:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.408621811s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.508094165s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:47:41 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.508129371s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X...........X..............] duration: 844.02495ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:47:35 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 844.051255ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [................................X..........X...X............] duration: 1.645966673s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:47:33 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.645996559s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [..............................X......X.X.X.XX..XX.X.........] duration: 298.520311ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:47:31 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 298.546516ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.619632962s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:47:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.619663397s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X...........X.............] duration: 1.057567644s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:47:03 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.057657847s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)