Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.290827264s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:44:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.290852645s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.316824006s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:43:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.316863125s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.292143462s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:43:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.292167241s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.388023157s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:42:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.388045951s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.36376702s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:41:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.363792681s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.363986863s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:40:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.364007111s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.287840874s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:39:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.287871177s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.282635641s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:39:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.282686344s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.273997054s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:39:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.274022244s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.250447046s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:38:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.250476659s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.299997518s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:38:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.30002689s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.395630898s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:37:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.395648818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.358264931s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:36:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.358297781s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.319742698s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:35:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.319838588s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.353723353s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:35:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.35376504s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.281110807s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:34:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.281143714s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.276212493s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:33:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.276226713s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.272989884s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:33:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.273014821s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.384378158s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:33:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.38441088s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X......................................................X....] duration: 2.322227155s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:32:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.322258176s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X......................................................X...] duration: 2.314343195s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:30:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.314374257s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X......................................................X..] duration: 2.299798264s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:30:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.299831041s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X......................................................X.] duration: 2.254313434s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:29:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 2.254334004s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X......................................................X] duration: 30.003134298s trace: https://jaeger.dev.storj.io/trace/30230c620b845632 FAIL (2026-02-01 22:29:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, Piece ID: 3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ) context deadline exceeded; piecestore: (Node ID: 125GxLsL5UtXkuJ1LFvF42N9iZkKtRK3rq63xdR25JQbtwoT1L5, Piece ID: VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ) context deadline exceeded; piecestore: (Node ID: 1u4KzGpsX41P8U5ZHLcjZMDGPEEF6R1CcNeTmp8NsPLkj9Putd, Piece ID: 7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ) context deadline exceeded ======LOGS====== rting upload Feb 1 22:29:17.097065040 (414h33m54.981019243s) [upload=364705]: Done starting upload Feb 1 22:29:17.097122569 (414h33m54.981076771s) [upload=364705]: Uploading segments... Feb 1 22:29:17.097334052 (414h33m54.981288252s) [upload=364705]: Got next segment. Inline: false Feb 1 22:29:17.097372902 (414h33m54.981327106s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 22:29:17.097382566 (414h33m54.981336768s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 22:29:17.335154673 (414h33m55.219108875s) [seg_pos={0 0}, upload=364705]: Begin upload segment... Feb 1 22:29:17.335214777 (414h33m55.219168962s) [seg_pos={0 0}, upload=364705]: Done begin upload segment. Feb 1 22:29:17.335243988 (414h33m55.21920992s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335270811 (414h33m55.219225014s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.335683574 (414h33m55.21963776s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.336329217 (414h33m55.220283425s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.337184254 (414h33m55.221138446s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338162334 (414h33m55.222116536s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338589715 (414h33m55.222543914s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.338970015 (414h33m55.222924214s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.339929314 (414h33m55.223883521s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.340432301 (414h33m55.224386506s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.341729997 (414h33m55.225684208s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.344593932 (414h33m55.228548136s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.345960875 (414h33m55.229915084s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.349088320 (414h33m55.233042522s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.351346093 (414h33m55.235300303s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:17.355249991 (414h33m55.239204196s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Uploading piece... Feb 1 22:29:18.158784611 (414h33m56.042738802s) [upload=364705]: Next returned nil segment Feb 1 22:29:18.158799506 (414h33m56.042753706s) [upload=364705]: Waiting for error group managing segments... Feb 1 22:29:18.318055393 (414h33m56.202009592s) [noise=true , address=145.79.227.48:4303 , piece_id=BY43CNMHXCTFZOSSNULOO4TR27B4YE7VFYUFAKC34D6RT7ABSKHQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.326949426 (414h33m56.210903615s) [noise=true , address=145.79.227.47:4265 , piece_id=SELVSN6KME2KWEF7VGGB6TEV6BFCCEMZHFWD3Y7LR2SJR3LDVE2Q, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.338836804 (414h33m56.22279101s) [noise=true , address=45.91.116.4:4952 , piece_id=LR5IYPCVPAGLYUHVCDAGMGRGCDVIAP3DQOSKMGHGF3KKWAD3PKCA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.347130482 (414h33m56.231084682s) [noise=true , address=145.79.227.29:4943 , piece_id=HUMNAP5FRVP5PRZ4NZ52C3GSJGZ5AAKAUREXOA257YDZLXR4RNMA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.354621383 (414h33m56.238575588s) [noise=true , address=45.91.116.12:4228 , piece_id=6ORCZCBTMORCNDU4N4MM42J6Z2JPYBMTH3YGVJGGYGRIMPCHN5EQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.452677102 (414h33m56.336631302s) [noise=true , address=45.91.116.8:4070 , piece_id=BJRLDCNCTMHZFJ5A3JIPP6DTTKFUOV7C66YNTCRVU3ZVVYPCSPMQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.453904919 (414h33m56.337859118s) [noise=true , address=45.91.116.9:4263 , piece_id=QLD2WX72V3TI7UX2NKDFO2LZXFTVPC4IPYTF3KC6VI2TXEL5NSFA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:18.496669154 (414h33m56.380623354s) [noise=true , address=145.79.227.49:4337 , piece_id=TFZV2EW4BNRPUS3VRLYUD75JN7FHHGSBUCCE7TFCENFXJMIPJFDQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:25.780280557 (414h34m3.664234751s) [noise=true , address=45.91.116.7:4012 , piece_id=CWOB3Y4EOZFRMJFT55ZOQG4DROX3QTJMAY5M2YZPRZ4KHAF5FZTA, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:30.888263039 (414h34m8.772217242s) [noise=true , address=145.79.227.46:4601 , piece_id=VNCIW3HRVWTGVC6YJLLFI5ZDHCYIYPZ5XWOKZD2ISI3TV3MNQCJQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:31.096281792 (414h34m8.980235992s) [noise=true , address=45.91.116.7:4026 , piece_id=7OFVR6YRQOTDJI5FK2ARKGS4IB6E23SHN4VVSXQ6XCDR5P6FKETQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:38.023583467 (414h34m15.907537659s) [noise=true , address=145.79.227.35:4481 , piece_id=HPROZBOKKDSNP7APCDIWH3YEVL6TCYEVU4A7JDAUAJG5LKKTD4WQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502030941 (414h34m19.385985142s) [noise=true , address=45.91.116.10:4082 , piece_id=3RJRH5YKAPIXRPNAG2KTHG2FCQDY4UQ5MTZ5E7GGZEIUAQFSIKRQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: <nil> Feb 1 22:29:41.502055111 (414h34m19.386009314s) [seg_pos={0 0}, upload=364705]: Satisfied cohort requirements after 13 pieces Feb 1 22:29:41.502424056 (414h34m19.386378281s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: read tcp 139.59.144.22:46532->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502436485 (414h34m19.386390691s) [noise=true , address=145.79.227.44:4193 , piece_id=ABLJ62MDO3SSNYAOAFLXFTNZYVNXAQJFNT6YW26LNY7RI4OMFOUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502653332 (414h34m19.386607533s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b): protocol: read tcp 139.59.144.22:34080->145.79.227.30:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502665251 (414h34m19.38661945s) [noise=true , address=145.79.227.30:4762 , piece_id=XI6P33L4CSBAMZDDOYDTNYEZYT3GVJH6WCGYZWXTKOOUOJFH7BUQ, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502870835 (414h34m19.386825044s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: read tcp 139.59.144.22:32998->145.79.227.35:4482: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 1 22:29:41.502881828 (414h34m19.386836032s) [noise=true , address=145.79.227.35:4482 , piece_id=A6RHMJWRT6VJVH267SIUUXAL4JV4QGAIJOV7GGH6MLJG65ESJV5A, seg_pos={0 0}, upload=364705]: Long tail cancellation due to optimal threshold Feb 1 22:29:41.502905946 (414h34m19.386860146s) [seg_pos={0 0}, upload=364705]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Feb 1 22:29:41.503017232 (414h34m19.386971438s) [upload=364705]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 1 22:29:41.503025370 (414h34m19.386979579s) [upload=364705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 1 22:29:41.658389046 (414h34m19.542343249s) [upload=364705]: Done uploading segments... Feb 1 22:29:41.658410012 (414h34m19.542364212s) [upload=364705]: Upload finished. err: <nil> Duration: 30.003153537s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.309053359s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:28:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.309103664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.383509018s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:27:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.383532413s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.253439561s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:26:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.253472863s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.330202922s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:26:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.330312648s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.30507842s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:25:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.30510602s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.300697519s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:23:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.300725316s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.262366338s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:23:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.262409763s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.305685821s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:23:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.305716023s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.32450927s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:22:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.324544526s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.273628959s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:21:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.273653003s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.299794997s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:20:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.299828231s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.328218257s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:20:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.328283391s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.435754834s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:20:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.435786327s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.289267624s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:19:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.289302038s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.333018172s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:18:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.333046101s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.301281436s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:17:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.301308216s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.309688447s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:16:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.309778543s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.269615316s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:16:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.26972546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.276705188s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:14:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.276730127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.237042383s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:14:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.237068128s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.332112845s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:13:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.332151543s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.354041844s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:13:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.354076108s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.275924131s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:12:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.275954757s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.342314665s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:11:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.34235226s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.323554308s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:11:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.323578661s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.29486548s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:10:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.29489686s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)