Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.50414758s FAIL (2025-10-09 00:17:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.504186711s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.547494606s FAIL (2025-10-09 00:16:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.547530342s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.534220078s FAIL (2025-10-09 00:16:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.534259062s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.595300549s FAIL (2025-10-09 00:15:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.59534083s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.512227643s FAIL (2025-10-09 00:14:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.51225801s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.516953932s FAIL (2025-10-09 00:13:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.517119246s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.474209153s FAIL (2025-10-09 00:13:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.474243288s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.451077932s FAIL (2025-10-09 00:11:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.451111692s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.515758748s FAIL (2025-10-09 00:11:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.515799866s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.612418433s FAIL (2025-10-09 00:10:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.612478827s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.546418902s FAIL (2025-10-09 00:09:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.546453568s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.504838988s FAIL (2025-10-09 00:08:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.504938829s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.777714051s FAIL (2025-10-09 00:07:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.777772211s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.568998896s FAIL (2025-10-09 00:06:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.569031568s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.556844419s FAIL (2025-10-09 00:06:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.556959337s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.595937533s FAIL (2025-10-09 00:05:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.595973742s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.609415589s FAIL (2025-10-09 00:04:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.60944945s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.56154872s FAIL (2025-10-09 00:04:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.561586803s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.536962049s FAIL (2025-10-09 00:03:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.537089103s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.693407784s FAIL (2025-10-09 00:02:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.69343859s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.792420206s FAIL (2025-10-09 00:01:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.792482368s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.548937869s FAIL (2025-10-09 00:00:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.549034096s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.516732979s FAIL (2025-10-08 23:59:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.516761831s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.547787837s FAIL (2025-10-08 23:59:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.547837093s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.645067487s FAIL (2025-10-08 23:58:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.645102502s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.451634577s FAIL (2025-10-08 23:57:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.451682823s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.655102849s FAIL (2025-10-08 23:56:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.655138392s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.514245365s FAIL (2025-10-08 23:56:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.51428305s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.495531469s FAIL (2025-10-08 23:55:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.495564178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.85412299s FAIL (2025-10-08 23:55:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.8541749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.462851502s FAIL (2025-10-08 23:54:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.462883642s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.465550225s FAIL (2025-10-08 23:53:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.465581977s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.50403141s FAIL (2025-10-08 23:52:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.504065459s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.467807605s FAIL (2025-10-08 23:51:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.467844027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.642319509s FAIL (2025-10-08 23:50:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.642351628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.552654928s FAIL (2025-10-08 23:49:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.552683497s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.655170369s FAIL (2025-10-08 23:48:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.655201426s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.604598917s FAIL (2025-10-08 23:47:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.604628029s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.610690246s FAIL (2025-10-08 23:47:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.610726544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.704160006s FAIL (2025-10-08 23:46:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.704204672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.682199878s FAIL (2025-10-08 23:45:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.682230195s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001636353s FAIL (2025-10-08 23:45:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 30.001664809s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.604845811s FAIL (2025-10-08 15:04:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.60487882s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.770221133s FAIL (2025-10-08 15:03:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.770326241s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.794469264s FAIL (2025-10-08 15:03:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.794530789s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.839352058s FAIL (2025-10-08 15:02:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.839408995s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.654402812s FAIL (2025-10-08 15:02:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.654451061s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.148824716s FAIL (2025-10-08 15:01:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.148933799s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.129086308s FAIL (2025-10-08 15:00:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.129117769s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.720583764s FAIL (2025-10-08 14:59:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.720619551s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)