Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 190523 reports (Page 383 of 3811)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [....................................X....X........X.........]
duration:
1.035673236s
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:46:59 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 1.035761189s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
2.400706439s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:46:56 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.400731965s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......................................................XX....]
duration:
2.308032833s
trace:
https://jaeger.dev.storj.io/trace/69a842eacf594af2
FAIL (2025-11-08 17:46:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov  8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload
Nov  8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload
Nov  8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments...
Nov  8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false
Nov  8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov  8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov  8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment...
Nov  8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment.
Nov  8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment
Nov  8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments...
Nov  8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces.
Nov  8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov  8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov  8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov  8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments...
Nov  8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.308066849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration:
2.35754411s
trace:
https://jaeger.dev.storj.io/trace/69a842eacf594af2
FAIL (2025-11-08 17:46:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov  8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload
Nov  8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload
Nov  8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments...
Nov  8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false
Nov  8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov  8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov  8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment...
Nov  8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment.
Nov  8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment
Nov  8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments...
Nov  8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces.
Nov  8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov  8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov  8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov  8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments...
Nov  8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.357563493s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.................................XX.........................]
duration:
2.049465225s
trace:
https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5
FAIL (2025-11-08 17:46:33 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.049494002s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...................................X...........X............]
duration:
1.116357935s
trace:
https://jaeger.dev.storj.io/trace/507a0a6af90e29da
FAIL (2025-11-08 17:46:24 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.116385031s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [...............................X......X.X.X.XX..XX.X........]
duration:
295.3453ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:46:19 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 295.39576ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [.................................X..........X...X...........]
duration:
1.603732054s
trace:
https://jaeger.dev.storj.io/trace/6bb9e3317e182100
FAIL (2025-11-08 17:46:18 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.603777313s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.....................................X....X........X........]
duration:
1.010677229s
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:46:15 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 1.010706037s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
2.397072261s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:46:10 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.397092606s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [................................X......X.X.X.XX..XX.X.......]
duration:
305.409432ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:45:42 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 305.436884ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [......................................X....X........X.......]
duration:
861.892247ms
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:45:36 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 861.994524ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..................................XX........................]
duration:
2.428029544s
trace:
https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5
FAIL (2025-11-08 17:45:31 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.428140602s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..]
duration:
2.392914643s
trace:
https://jaeger.dev.storj.io/trace/69a842eacf594af2
FAIL (2025-11-08 17:45:25 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov  8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload
Nov  8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload
Nov  8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments...
Nov  8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false
Nov  8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov  8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov  8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment...
Nov  8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment.
Nov  8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment
Nov  8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments...
Nov  8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces.
Nov  8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov  8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov  8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov  8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments...
Nov  8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.392944747s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
2.463753568s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:45:22 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.463798554s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [....................................X...........X...........]
duration:
905.946533ms
trace:
https://jaeger.dev.storj.io/trace/507a0a6af90e29da
FAIL (2025-11-08 17:45:21 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 905.994247ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [..................................X..........X...X..........]
duration:
1.574639157s
trace:
https://jaeger.dev.storj.io/trace/6bb9e3317e182100
FAIL (2025-11-08 17:45:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.574669176s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...................................XX.......................]
duration:
2.516350609s
trace:
https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5
FAIL (2025-11-08 17:45:02 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.51645969s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.......................................X....X........X......]
duration:
881.067309ms
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:44:56 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 881.184682ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.]
duration:
3.363151989s
trace:
https://jaeger.dev.storj.io/trace/69a842eacf594af2
FAIL (2025-11-08 17:44:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov  8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload
Nov  8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload
Nov  8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments...
Nov  8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false
Nov  8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov  8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov  8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment...
Nov  8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment.
Nov  8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment
Nov  8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments...
Nov  8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces.
Nov  8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov  8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov  8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov  8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments...
Nov  8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.363179108s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
4m38.036729358s
trace:
https://jaeger.dev.storj.io/trace/69a842eacf594af2
FAIL (2025-11-08 17:44:48 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov  8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload
Nov  8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload
Nov  8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments...
Nov  8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false
Nov  8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov  8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov  8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment...
Nov  8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment.
Nov  8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece...
Nov  8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment
Nov  8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments...
Nov  8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009     , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690   , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555     , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437   , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329    , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763   , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799   , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699     , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114    , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226    , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838   , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010     , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227    , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil>
Nov  8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces.
Nov  8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803   , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510   , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Nov  8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663     , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold
Nov  8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov  8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov  8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov  8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments...
Nov  8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4m38.036758769s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [.................................X......X.X.X.XX..XX.X......]
duration:
292.60988ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:44:40 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 292.639613ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [...................................X..........X...X.........]
duration:
1.682699485s
trace:
https://jaeger.dev.storj.io/trace/6bb9e3317e182100
FAIL (2025-11-08 17:44:40 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.682731419s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
2.282070123s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:44:28 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.282093158s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...........X..........]
duration:
1.1391914s
trace:
https://jaeger.dev.storj.io/trace/507a0a6af90e29da
FAIL (2025-11-08 17:44:24 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.139225129s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [..................................X......X.X.X.XX..XX.X.....]
duration:
272.697197ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:44:23 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 272.738078ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................]
duration:
2.275715237s
trace:
https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5
FAIL (2025-11-08 17:44:05 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.275917481s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.376853712s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:44:01 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.376884049s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [........................................X....X........X.....]
duration:
1.109578032s
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:43:52 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 1.109652116s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [...................................X......X.X.X.XX..XX.X....]
duration:
297.775936ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:43:51 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 297.808126ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [....................................X..........X...X........]
duration:
1.723469035s
trace:
https://jaeger.dev.storj.io/trace/6bb9e3317e182100
FAIL (2025-11-08 17:43:50 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.723493204s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [....................................X......X.X.X.XX..XX.X...]
duration:
293.741106ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:43:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 293.779683ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................X....X........X....]
duration:
1.060782352s
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:43:19 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 1.060878484s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......................................X...........X.........]
duration:
883.578826ms
trace:
https://jaeger.dev.storj.io/trace/507a0a6af90e29da
FAIL (2025-11-08 17:43:11 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 883.613438ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.593717033s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:43:09 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.593749133s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................]
duration:
2.181062865s
trace:
https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5
FAIL (2025-11-08 17:42:50 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.181201754s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [.....................................X..........X...X.......]
duration:
2.141490658s
trace:
https://jaeger.dev.storj.io/trace/6bb9e3317e182100
FAIL (2025-11-08 17:42:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.141807968s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [..........................................X....X........X...]
duration:
925.128284ms
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:42:40 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 925.16076ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [.....................................X......X.X.X.XX..XX.X..]
duration:
293.748152ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:42:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 293.842899ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...........X........]
duration:
1.185719621s
trace:
https://jaeger.dev.storj.io/trace/507a0a6af90e29da
FAIL (2025-11-08 17:42:32 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.185740746s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.227434302s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:42:26 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.227467173s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...........................................X....X........X..]
duration:
1.026650175s
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:42:22 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 1.026680139s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [......................................X......X.X.X.XX..XX.X.]
duration:
290.671712ms
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:42:08 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 290.701638ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................]
duration:
2.518880392s
trace:
https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5
FAIL (2025-11-08 17:41:45 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.518910953s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [......................................X..........X...X......]
duration:
1.542733723s
trace:
https://jaeger.dev.storj.io/trace/6bb9e3317e182100
FAIL (2025-11-08 17:41:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.542770056s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
2.31728862s
trace:
https://jaeger.dev.storj.io/trace/667af7ecec748423
FAIL (2025-11-08 17:41:32 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.317381822s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
9 out of 60 is failed (threshold=3) [.......................................X......X.X.X.XX..XX.X]
duration:
30.001074043s
target:
https://us1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/282d694e86fcb700
FAIL (2025-11-08 17:41:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 30.001105349s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........................................X...........X.......]
duration:
1.005793052s
trace:
https://jaeger.dev.storj.io/trace/507a0a6af90e29da
FAIL (2025-11-08 17:41:21 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1.0058244s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [............................................X....X........X.]
duration:
952.274581ms
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:41:14 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 952.290263ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.............................................X....X........X]
duration:
30.000817033s
trace:
https://jaeger.dev.storj.io/trace/197ffda43a2a97c2
FAIL (2025-11-08 17:41:13 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 30.000840442s core uplink us1