Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.2532672s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:09:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.253351136s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.328518825s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:08:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.328544507s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.287107346s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:08:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.287146063s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.304506799s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:06:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.304533587s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.2728719s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:06:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.272895478s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.267684273s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:05:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.267709182s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.335195018s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:05:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.335224027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.327488469s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:04:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.327511984s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.438612806s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:03:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.438637739s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.462789034s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:03:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.462836723s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.954111945s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:02:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.954138945s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.739844674s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:02:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.739875834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.545612799s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:01:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.545687582s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.278824638s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:00:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.278845795s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.346124045s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 22:00:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.346146852s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.341040963s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:59:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.341072715s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.48940902s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:58:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.489441765s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.373927424s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:56:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.373974134s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.294523301s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:56:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.294553744s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.32550402s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:55:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.325541023s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.361138608s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:54:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.361160345s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.415491948s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:54:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.4155313s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.336710166s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:53:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.336731764s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.289979495s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:52:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.290008851s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.283904167s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:51:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.283998974s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.292464822s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:50:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.292498516s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.541830567s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:50:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.541857731s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.787691607s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:49:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 2.787721822s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.10900287s trace: https://jaeger.dev.storj.io/trace/67dcd2a76bfe9ed3 FAIL (2026-02-01 21:49:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== ing upload Feb 1 21:48:59.207488119 (413h53m37.091442311s) [upload=364101]: Uploading segments... Feb 1 21:48:59.207533539 (413h53m37.091487748s) [upload=364101]: Got next segment. Inline: false Feb 1 21:48:59.207563551 (413h53m37.091517751s) [upload=364101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 1 21:48:59.207568679 (413h53m37.091522878s) [upload=364101]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 1 21:48:59.319077752 (413h53m37.203031951s) [seg_pos={0 0}, upload=364101]: Begin upload segment... Feb 1 21:48:59.319133976 (413h53m37.203088176s) [seg_pos={0 0}, upload=364101]: Done begin upload segment. Feb 1 21:48:59.319163862 (413h53m37.203118068s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319261744 (413h53m37.203215954s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.319813318 (413h53m37.20376753s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320269826 (413h53m37.204224038s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.320781193 (413h53m37.204735403s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321255159 (413h53m37.205209372s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.321697243 (413h53m37.205651453s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322223973 (413h53m37.2061782s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.322796589 (413h53m37.206750798s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.324611431 (413h53m37.208565639s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.326120913 (413h53m37.210075117s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.330596341 (413h53m37.214550551s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335009612 (413h53m37.218963838s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.335846212 (413h53m37.219800421s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.341777238 (413h53m37.225731657s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.343859806 (413h53m37.227814015s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Uploading piece... Feb 1 21:48:59.949313359 (413h53m37.833267559s) [upload=364101]: Next returned nil segment Feb 1 21:48:59.949326611 (413h53m37.833280796s) [upload=364101]: Waiting for error group managing segments... Feb 1 21:49:00.083846108 (413h53m37.967800317s) [noise=true , address=45.91.116.7:4011 , piece_id=R34Y32RPHYLPBPSZU65W5RH22PF3ASZEQXZKTV2NLMUVLWGUQXTQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.179734331 (413h53m38.063688525s) [noise=true , address=45.91.116.14:4191 , piece_id=2HBZL6CR666LSKR2XMRF2SNC4WYO63JWZ736G6JTL6B46WOADQAA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:00.721715538 (413h53m38.605669727s) [noise=true , address=77.90.31.17:4770 , piece_id=VN7SJCXQ5JGIJKZNSCNAWWMSESNAMFO6QPBZVNROP5LQWCGOSKXQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:08.910087100 (413h53m46.79404131s) [noise=true , address=145.79.227.48:4303 , piece_id=UILN6Z22DLD44XGNLFN6IJ25OOGMS2UFLZY2GWEJ7IZDDUT4HHVA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:09.820345657 (413h53m47.704299853s) [noise=true , address=145.79.227.30:4762 , piece_id=2ZQFDK2DFFU54KGV4VXYUKK3PF7W6LXJG4AOC5YO44FV76GP4SHA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:22.142650311 (413h54m0.026604513s) [noise=true , address=145.79.227.48:4301 , piece_id=FPIA2WY4W6POQZI3JWHZGE7FBACJNMIIMLB4JSBMNYPHM776HM5Q, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:23.176609757 (413h54m1.060563962s) [noise=true , address=145.79.227.35:4482 , piece_id=WJHWIIEJNVYHZXCG6OEA5VDJVKZUNYK5VKUF4WCHK57QHIDBY2BA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:24.824944281 (413h54m2.708898484s) [noise=true , address=145.79.227.44:4195 , piece_id=DMTDY44VMO6WQIWTGNHAHH742DMEVKKREFPAEMYKLEMZKP2XG4JA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:25.949482969 (413h54m3.833437169s) [noise=true , address=145.79.227.29:4941 , piece_id=6LQYWYINW53AYZC2WV6QBKKBK5OOI3MHVPAWKGZYDWG7SCEFZZZA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:27.767517729 (413h54m5.651471914s) [noise=true , address=145.79.227.33:4870 , piece_id=B4QZDAMGCUH6QN6INDI6YT3YK5DQBCD5G727I5AYW3UELPWHQ3PA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: <nil> Feb 1 21:49:28.913580900 (413h54m6.797535109s) [noise=true , address=145.79.227.49:4338 , piece_id=QO2NXPV6HIWHD2T5YHGX2BYKRVSXRUXDQDPXPCSC62KQSZLWVFQQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52362->145.79.227.49:4338: use of closed network connection Feb 1 21:49:28.913638423 (413h54m6.797592623s) [noise=true , address=145.79.227.51:4409 , piece_id=V5WHE6NPV4Z3FORGAEAFKVGIGFDVEYOYK4CBD4XXFOWCGOXH73SA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39746->145.79.227.51:4409: use of closed network connection Feb 1 21:49:28.913802146 (413h54m6.797756356s) [noise=true , address=145.79.227.43:4157 , piece_id=VUNG2BHVL47IA2E5BKIU3DLBXAM5OODJMSKADGZQDWBABG2JJLFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz, address:145.79.227.43:4157): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.913861460 (413h54m6.79781567s) [noise=true , address=145.79.227.34:4906 , piece_id=SLAZ3WGQMOMTG3BNIZDCD5RNXX2CUU5XQLOTJ64YACTQDKCR4JOQ, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32886->145.79.227.34:4906: use of closed network connection Feb 1 21:49:28.913890806 (413h54m6.797845012s) [noise=true , address=145.79.227.37:4565 , piece_id=HGBMWNJA6IIUGMAOVKCEV3DAWHT6LDIARLJJDEAPGSYDYFCB3HFA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, address:145.79.227.37:4565): protocol: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46816->145.79.227.37:4565: use of closed network connection Feb 1 21:49:28.914116117 (413h54m6.798070319s) [noise=true , address=145.79.227.49:4339 , piece_id=7YXSBUJ3E4VEZUWNEQGBBTHHQRAADPMFOPGZSHCVUOJUSYL6CWSA, seg_pos={0 0}, upload=364101]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: expected piece hash; context deadline exceeded; EOF Feb 1 21:49:28.914149710 (413h54m6.798103903s) [seg_pos={0 0}, upload=364101]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Feb 1 21:49:29.020104703 (413h54m6.904058894s) [upload=364101]: Done uploading segments... Feb 1 21:49:29.020154783 (413h54m6.904108985s) [upload=364101]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.10906343s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 216.794747ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:39:21 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 216.820261ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 212.832405ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:38:48 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 212.858327ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 218.686109ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:38:27 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 218.711779ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 225.931096ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:38:01 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 225.95762ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 219.159077ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:37:08 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 219.190954ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 175.851172ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:36:16 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 175.874095ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 174.65136ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:35:23 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 174.678335ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 490.211733ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:34:30 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 490.247607ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 216.355223ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:33:28 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 216.385517ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 249.955721ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:32:46 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 249.99269ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 877.107163ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:32:23 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 877.130728ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 632.930975ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:31:27 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 632.958718ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 216.363811ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:30:38 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 216.432452ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 196.005316ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:29:56 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 196.035408ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 177.692066ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:28:45 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 177.72189ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 188.576941ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:27:41 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 188.602685ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 495.263964ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:26:46 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 495.285343ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 181.967749ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:25:49 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 181.998882ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 178.040648ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:25:23 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 178.146673ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 530.070302ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:25:02 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 530.096451ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 219.864244ms remote: "tcp:185.244.226.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/333a6cd527e4d29c FAIL (2026-02-01 19:24:12 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 219.915502ms edge linksharing bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)