Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.381627861s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 21:00:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.381653204s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.377022019s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:59:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.377054048s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.298070051s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:59:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.298097761s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.375421658s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:58:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.375454099s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.386227269s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:57:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.386251979s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.396841406s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:56:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.396889953s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.361794564s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:56:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.361827082s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.353288373s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:55:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.353318062s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.363809341s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:54:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.363834703s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.54761936s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:54:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.54764772s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.468143057s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:53:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.468168637s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.418477527s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:53:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.418503969s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.394951902s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:52:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.395046149s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.276878124s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:51:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.276913221s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.4971597s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:50:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.497191036s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.381485979s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:49:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.381519221s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.437522291s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:48:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.437637157s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 13.331113331s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:48:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 13.331141328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.357631606s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:46:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.357666097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.257617718s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:45:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.25765673s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.361484581s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:44:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.361504983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.343607737s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:43:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.343633411s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.348297591s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:43:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.348327503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.501638684s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:42:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.501668259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.097861137s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:41:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.097887898s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.366304954s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:40:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.366331571s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.143806173s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:40:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.143838208s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.358755308s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:39:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.358779889s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.478313424s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:39:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.4783455s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.467125887s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:38:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.467161876s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.930838436s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:38:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.930867946s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.402074409s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:37:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.402114247s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.172353555s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:36:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 3.172433374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.457553454s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:35:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.45757403s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.111366753s trace: https://jaeger.dev.storj.io/trace/3c8a03916dd3efb0 FAIL (2026-02-08 20:35:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Feb 8 20:35:15.284031765 (580h39m53.167985964s) [upload=511155]: Starting upload Feb 8 20:35:15.284112500 (580h39m53.168066701s) [upload=511155]: Done starting upload Feb 8 20:35:15.284149599 (580h39m53.168103791s) [upload=511155]: Uploading segments... Feb 8 20:35:15.284601793 (580h39m53.168555992s) [upload=511155]: Got next segment. Inline: false Feb 8 20:35:15.284721869 (580h39m53.16867607s) [upload=511155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 20:35:15.284728431 (580h39m53.16868263s) [upload=511155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 20:35:15.397389353 (580h39m53.281343559s) [seg_pos={0 0}, upload=511155]: Begin upload segment... Feb 8 20:35:15.397453134 (580h39m53.281407318s) [seg_pos={0 0}, upload=511155]: Done begin upload segment. Feb 8 20:35:15.397517573 (580h39m53.281471782s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.397533666 (580h39m53.281487892s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398120348 (580h39m53.282074556s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.398572052 (580h39m53.282526262s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399001740 (580h39m53.282955955s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399492847 (580h39m53.283447038s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.399954482 (580h39m53.283908691s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.400483442 (580h39m53.284437649s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.402650352 (580h39m53.286604556s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.404412781 (580h39m53.288366984s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.406266549 (580h39m53.290220752s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.407902210 (580h39m53.291856418s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.409594415 (580h39m53.293548626s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.410340922 (580h39m53.294295132s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411911194 (580h39m53.2958654s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:15.411928878 (580h39m53.29588307s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Uploading piece... Feb 8 20:35:16.207177374 (580h39m54.091131559s) [upload=511155]: Next returned nil segment Feb 8 20:35:16.207191375 (580h39m54.091145561s) [upload=511155]: Waiting for error group managing segments... Feb 8 20:35:16.334354958 (580h39m54.21830916s) [noise=true , address=77.90.31.12:4589 , piece_id=PNNGHWTVU2Q5MKHVVHSDTNBC67PCNAS6RB2UDAVILBC72EWI3LOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.335358031 (580h39m54.21931223s) [noise=true , address=77.90.31.16:4735 , piece_id=LOXMIJRR3E3V36HUELF3BAM4TG5DCNL37TK6WP54X3OL4A7PHSFQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.337810738 (580h39m54.221764931s) [noise=true , address=77.90.31.14:4663 , piece_id=LX32SOLAV54LL37GSXEUQYEFU5UV4YXZULFOSE4TON43HJZVHQCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.338164047 (580h39m54.222118238s) [noise=true , address=77.90.31.19:4841 , piece_id=CSPTVQ54Z3MMEOC7ZA4QXQEXNHS6WDGC5DSBH5O5G65BTJK4WOOQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.342858708 (580h39m54.226812913s) [noise=true , address=145.79.227.42:4123 , piece_id=NPPJ2GEXVWE5OFCUBZVJP3XSZOXTOVHQK5IWDC3DV653DU2KSUHQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.343378259 (580h39m54.227332458s) [noise=true , address=45.91.116.12:4244 , piece_id=RCA4ATQF22KSJ2JEET4XXMAAQK5S3KVYSY4UOJEX2VC6MTYJKDZA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.345609935 (580h39m54.229564141s) [noise=true , address=77.90.31.17:4773 , piece_id=ULHWAAU4FL3VIF3ELDVHDMLXQ77U3F4LLDW4ZYXWKEJVU3ILXZEA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.350042706 (580h39m54.233996915s) [noise=true , address=45.91.116.4:4952 , piece_id=4MFOEWCPDPR6WDQBRWWYLFUDKQDO6BGXXCY7VPBUB7XDSEN25YOA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.379091195 (580h39m54.263045398s) [noise=true , address=77.90.31.15:4700 , piece_id=SH4DGURZPM4E7W3PXW6LAXAPSBPCZHVDPPP43K3FZVJN5OQRXR6A, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.387202016 (580h39m54.271156202s) [noise=true , address=77.90.31.10:4519 , piece_id=IVSFMBTNVCUIJWJGC4DWHKQEC6HGGTXKBLVCKAQLNHE3CEUSDOGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:16.390136524 (580h39m54.274090711s) [noise=true , address=45.91.116.7:4024 , piece_id=52MSPAT5O2G2XTLNNWMD4PTBGRCL6UMXZAO6CKP2C4CKJYEP25MQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:44.095174165 (580h40m21.979128365s) [noise=true , address=79.127.219.46:4893 , piece_id=G3JMHW4TTJBUGZXFQ6JMYSWZGG54YFSLAUO5NMJ64KZCPLNESIAA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: <nil> Feb 8 20:35:45.002467024 (580h40m22.886421233s) [noise=true , address=79.127.219.41:4927 , piece_id=DC4VW465KZXLINYS7AFC7CKH2M5M7UN2KHPIGEVPTQQFLJWHJQXQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:1JgPWqe81FwGvfduteWKs6QAmxY3Av3Nbd4RBu4fcZh5rH3RMM, address:79.127.219.41:4927): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002509190 (580h40m22.886463383s) [noise=true , address=79.127.219.38:4820 , piece_id=D4YYXV3FUYB6CWOZFBMBVCOEOQQHC4F4YBOYNW2WDEKR5FB6NCGA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002708091 (580h40m22.886662296s) [noise=true , address=45.91.116.4:4947 , piece_id=OO27KHBM6HQWUWWPYUDGFFCG2HX3KI2NYIYO7O6YFLKS4B5Z3DCQ, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:19MoR7r7wEgpnEpEesf4oJzFsWZmygg7mxg4jCtGf9rhJDw56B, address:45.91.116.4:4947): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002855562 (580h40m22.88680977s) [noise=true , address=79.127.219.41:4930 , piece_id=DAI2WRJQOH6TYDBINB42V6SQWWXX6Z6UUDYTOVKZM3T3N3HKNTCA, seg_pos={0 0}, upload=511155]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: expected piece hash; context deadline exceeded; EOF Feb 8 20:35:45.002888009 (580h40m22.886842201s) [seg_pos={0 0}, upload=511155]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Feb 8 20:35:45.110856986 (580h40m22.994811201s) [upload=511155]: Done uploading segments... Feb 8 20:35:45.110918692 (580h40m22.994872902s) [upload=511155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.111392104s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.709225652s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:05:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.709351218s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 2.488445951s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:04:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.488500901s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 1.685273086s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:04:35 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.68530202s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.670776194s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:04:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.670805885s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 2.528614015s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:04:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.528652535s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.724210658s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:03:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.724304738s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 1.641213898s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:03:56 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.641238649s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 2.322668431s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:03:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.322738137s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.761103766s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:03:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.761119678s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 1.660775891s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:03:13 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.660871437s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.826419006s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:02:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.826472698s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 2.452219021s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:02:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.452351115s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 2.118057712s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:02:47 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.118083458s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 1.786574809s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:02:32 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.786607506s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 2.398246913s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:02:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.398279637s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)