Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X....X........X..............................] duration: 874.554281ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:02:53 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 874.585574ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [............X......X.X.X.XX..XX.X...........................] duration: 349.722015ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:02:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 349.738465ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 2.239080901s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:02:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.239107922s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X....X........X.............................] duration: 897.798975ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:02:32 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 897.828583ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........X..........X...X...................................] duration: 1.602384774s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:02:31 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.602411614s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...........X...................................] duration: 919.266301ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:02:29 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 919.29266ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.286729635s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:02:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.286753333s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 2.557100359s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:02:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.557135695s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 2.275736233s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:01:59 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.275768404s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..........X..........X...X..................................] duration: 1.637603595s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:01:54 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.637628193s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 2.333843221s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:01:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.333893096s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.............X......X.X.X.XX..XX.X..........................] duration: 291.796019ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:01:50 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 291.829842ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X....X........X............................] duration: 902.505106ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:01:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 902.543164ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...........X..................................] duration: 983.307899ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:01:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 983.334127ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...........X..........X...X.................................] duration: 1.562562982s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:01:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.562591167s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [..............X......X.X.X.XX..XX.X.........................] duration: 292.572723ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:01:25 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 292.635202ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.487880533s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:01:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.487927776s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [............X..........X...X................................] duration: 2.181636089s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:01:16 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.181713454s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 2.197260168s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:01:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.197372283s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X....X........X...........................] duration: 851.945551ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:01:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 851.982427ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...........X.................................] duration: 880.338922ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:00:51 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 880.396118ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 2.288137818s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:00:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.288178593s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.388545309s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:00:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.388576879s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 2.585378279s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:00:35 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.585460883s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X....X........X..........................] duration: 1.024127865s trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:00:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.024154459s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [...............X......X.X.X.XX..XX.X........................] duration: 291.622243ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:00:27 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 291.652524ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.............X..........X...X...............................] duration: 1.58939791s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:00:19 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.589427868s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.36247201s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:00:18 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.362506553s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 2.47460904s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:00:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.474642818s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X....X........X.........................] duration: 1.057815401s trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:59:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.057844825s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...........X................................] duration: 873.697916ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:59:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 873.734607ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.276313578s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:59:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.276337839s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 2.514344299s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:59:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.514448499s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............X..........X...X..............................] duration: 1.602485267s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:59:35 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.602588277s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [................X......X.X.X.XX..XX.X.......................] duration: 295.105253ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:59:31 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 295.214352ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 2.596834896s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:59:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.596865696s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...........X...............................] duration: 945.534743ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:59:15 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 945.583734ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...............X..........X...X.............................] duration: 1.561494748s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:59:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.561515324s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 2.679782161s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:59:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.679821899s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 2.307330007s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:58:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.3074168s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X....X........X........................] duration: 931.171395ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:58:59 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 931.201538ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [................X..........X...X............................] duration: 2.183184868s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:58:54 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.183210413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.250383797s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 17:58:49 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.250487314s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 2.328083595s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 17:58:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.328115785s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...........X..............................] duration: 853.779517ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 17:58:37 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 853.818142ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.................X..........X...X...........................] duration: 1.624589874s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 17:58:36 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.62463555s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.................X......X.X.X.XX..XX.X......................] duration: 294.652602ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:58:31 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 294.734303ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 2.580063095s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 17:58:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.580095196s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X....X........X.......................] duration: 845.811392ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 17:58:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 845.8576ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [..................X......X.X.X.XX..XX.X.....................] duration: 301.524908ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 17:57:58 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 301.615217ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)