Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.340503583s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:26:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.340533s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.526122349s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:25:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.526154298s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.416391826s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:24:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.416426688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.449612668s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:24:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.449644588s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.748003527s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:23:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.748053012s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.666666074s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:22:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.666696764s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.426039714s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:21:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.426076117s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.343652522s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:20:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.343685406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.44062583s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:19:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.44068818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.474403613s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:18:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.474644035s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.293438533s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:17:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.293468055s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.301224501s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:16:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.301330651s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.369650612s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:15:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.369713558s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.580978706s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:15:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.581092901s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.406277568s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:14:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.406307762s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.302136898s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:13:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.302172337s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.376253578s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:12:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.376383104s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.320460959s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:12:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.320581298s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.458638527s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.458672942s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.396066199s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:10:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.396159374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.313126849s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:10:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.313158834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.326356309s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:09:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.326390468s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.388388747s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.38842353s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.42338974s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:07:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.42341729s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.344540697s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:06:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.344610838s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.481067728s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:06:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.481101562s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.377382648s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:06:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.377410887s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.494461969s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:05:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.494556302s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.408184479s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:04:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.40821212s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.364554006s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:04:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.364593111s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.453878087s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:03:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.453916845s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.459249029s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:02:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.459282687s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.34145749s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:01:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.341491085s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.310312434s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:01:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.310358302s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.381090905s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:00:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.381122401s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.265162993s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:59:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.265195129s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.295740675s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:58:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.295761667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.294656743s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:58:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.294678607s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.353356131s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:57:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.35338163s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.369886567s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:57:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.369915757s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.426011183s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:55:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.426098954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.42713387s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:55:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.427230512s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.373865241s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:54:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.373961288s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.108118186s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 10:54:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.108149903s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.83473478s trace: https://jaeger.dev.storj.io/trace/53697d5327201e55 FAIL (2026-04-04 05:08:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.834836653s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.039041353s trace: https://jaeger.dev.storj.io/trace/53697d5327201e55 FAIL (2026-04-04 05:07:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.039356301s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 1.69264371s trace: https://jaeger.dev.storj.io/trace/5ae72a7d1163165c FAIL (2026-04-04 05:07:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.692674208s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.669907512s trace: https://jaeger.dev.storj.io/trace/53697d5327201e55 FAIL (2026-04-04 05:06:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.669949161s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 1.795024816s trace: https://jaeger.dev.storj.io/trace/5ae72a7d1163165c FAIL (2026-04-04 05:06:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.795114822s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.339981863s trace: https://jaeger.dev.storj.io/trace/53697d5327201e55 FAIL (2026-04-04 05:05:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.340014085s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)