Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.608891878s FAIL (2025-10-07 09:00:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.608941792s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.668597234s FAIL (2025-10-07 09:00:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.668636194s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.097660161s FAIL (2025-10-07 08:59:45 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.097703038s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.206983458s FAIL (2025-10-07 08:59:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.207010383s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.799590912s FAIL (2025-10-07 08:59:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.799630687s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.431149614s FAIL (2025-10-07 08:59:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.431185495s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.166895225s FAIL (2025-10-07 08:59:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.166984405s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.408892197s FAIL (2025-10-07 08:58:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.40892164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.238297191s FAIL (2025-10-07 08:58:33 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.238330776s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.067545475s FAIL (2025-10-07 08:58:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.067581749s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 13.17675398s FAIL (2025-10-07 08:58:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 13.176786614s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 19.549843496s FAIL (2025-10-07 08:58:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 19.549861538s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001359799s FAIL (2025-10-07 08:58:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001394742s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000917669s FAIL (2025-10-07 08:58:00 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.000949606s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001512459s FAIL (2025-10-07 08:57:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001538834s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.455501835s FAIL (2025-10-07 08:56:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.455534436s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.448103666s FAIL (2025-10-07 08:56:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.448155042s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.35184864s FAIL (2025-10-07 08:55:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.351884539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.348566368s FAIL (2025-10-07 08:55:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.348603634s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.416365472s FAIL (2025-10-07 08:54:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.416406777s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.420957226s FAIL (2025-10-07 08:53:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.421065991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.435881302s FAIL (2025-10-07 08:52:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.435909377s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.437291428s FAIL (2025-10-07 08:51:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.437311571s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.340296838s FAIL (2025-10-07 08:50:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.340326649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.364691447s FAIL (2025-10-07 08:49:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.36471914s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.338628256s FAIL (2025-10-07 08:49:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.338654464s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.388243482s FAIL (2025-10-07 08:48:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.388295095s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.487072145s FAIL (2025-10-07 08:48:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.487094686s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.438685952s FAIL (2025-10-07 08:47:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.438716115s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.411464431s FAIL (2025-10-07 08:47:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.411498398s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.444246554s FAIL (2025-10-07 08:46:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.444280828s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.372215558s FAIL (2025-10-07 08:46:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.372285469s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.37656239s FAIL (2025-10-07 08:45:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.376678269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.428172736s FAIL (2025-10-07 08:44:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.428210596s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.448256762s FAIL (2025-10-07 08:43:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.448296324s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.3875646s FAIL (2025-10-07 08:42:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.387616301s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 3.514937947s FAIL (2025-10-07 08:42:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 3.514968127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.386598628s FAIL (2025-10-07 08:41:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.386629997s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.393080835s FAIL (2025-10-07 08:40:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.3931102s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.624347953s FAIL (2025-10-07 08:39:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.624385159s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.444878414s FAIL (2025-10-07 08:38:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.444909057s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.489069282s FAIL (2025-10-07 08:37:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.489101229s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.651081717s FAIL (2025-10-07 08:36:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.65116314s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.312737165s FAIL (2025-10-07 08:36:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.312795025s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.471310638s FAIL (2025-10-07 08:35:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.471348745s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.374264048s FAIL (2025-10-07 08:34:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.37429467s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.398309015s FAIL (2025-10-07 08:33:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.398342605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.403043197s FAIL (2025-10-07 08:33:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.403079091s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.58464171s FAIL (2025-10-07 08:32:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.584695328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.507237257s FAIL (2025-10-07 08:31:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 5s) [upload=291132]: Uploading segments... Oct 7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false Oct 7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment... Oct 7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment. Oct 7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece... Oct 7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment Oct 7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments... Oct 7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298 , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119 , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974 , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661 , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940 , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807 , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699 , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910 , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801 , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803 , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113 , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil> Oct 7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293 , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection Oct 7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221 , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection Oct 7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150 , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection Oct 7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873 , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection Oct 7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257 , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection Oct 7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments... Oct 7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.507273091s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)