Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.548937869s FAIL (2025-10-09 00:00:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.549034096s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.516732979s FAIL (2025-10-08 23:59:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.516761831s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.547787837s FAIL (2025-10-08 23:59:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.547837093s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.645067487s FAIL (2025-10-08 23:58:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.645102502s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.451634577s FAIL (2025-10-08 23:57:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.451682823s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.655102849s FAIL (2025-10-08 23:56:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.655138392s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.514245365s FAIL (2025-10-08 23:56:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.51428305s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.495531469s FAIL (2025-10-08 23:55:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.495564178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.85412299s FAIL (2025-10-08 23:55:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.8541749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.462851502s FAIL (2025-10-08 23:54:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.462883642s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.465550225s FAIL (2025-10-08 23:53:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.465581977s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.50403141s FAIL (2025-10-08 23:52:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.504065459s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.467807605s FAIL (2025-10-08 23:51:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.467844027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.642319509s FAIL (2025-10-08 23:50:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.642351628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.552654928s FAIL (2025-10-08 23:49:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.552683497s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.655170369s FAIL (2025-10-08 23:48:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.655201426s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.604598917s FAIL (2025-10-08 23:47:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.604628029s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.610690246s FAIL (2025-10-08 23:47:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.610726544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.704160006s FAIL (2025-10-08 23:46:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.704204672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.682199878s FAIL (2025-10-08 23:45:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 2.682230195s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001636353s FAIL (2025-10-08 23:45:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 8 23:44:46.921985642 (370h14m34.725450224s) [upload=325729]: Starting upload Oct 8 23:44:46.922065428 (370h14m34.725530028s) [upload=325729]: Done starting upload Oct 8 23:44:46.922142420 (370h14m34.725607004s) [upload=325729]: Uploading segments... Oct 8 23:44:46.922425032 (370h14m34.725889624s) [upload=325729]: Got next segment. Inline: false Oct 8 23:44:46.922479564 (370h14m34.725944159s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 23:44:46.922495772 (370h14m34.725960368s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 23:44:47.034162922 (370h14m34.837627521s) [seg_pos={0 0}, upload=325729]: Begin upload segment... Oct 8 23:44:47.034254844 (370h14m34.837719443s) [seg_pos={0 0}, upload=325729]: Done begin upload segment. Oct 8 23:44:47.034283487 (370h14m34.837748088s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034298536 (370h14m34.83776313s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034418373 (370h14m34.837882965s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.034964915 (370h14m34.838429516s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.035520165 (370h14m34.838984766s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036117717 (370h14m34.839582318s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.036877301 (370h14m34.84034189s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.039108249 (370h14m34.842572846s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.040992741 (370h14m34.844457341s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.042971230 (370h14m34.84643583s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.045131872 (370h14m34.848596472s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.046982560 (370h14m34.85044716s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.048622564 (370h14m34.852087165s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.052953512 (370h14m34.856418111s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.055683022 (370h14m34.859147645s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.057343404 (370h14m34.860808003s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Uploading piece... Oct 8 23:44:47.732471340 (370h14m35.535935932s) [upload=325729]: Next returned nil segment Oct 8 23:44:47.732496477 (370h14m35.535961081s) [upload=325729]: Waiting for error group managing segments... Oct 8 23:44:47.844246193 (370h14m35.647710771s) [noise=true , address=145.79.227.17:4971 , piece_id=25KKFVIUAJWVW6KLWBCGVVLGYFRPIPTZXTPEDWXWE6NRQ2OIXQDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.857316735 (370h14m35.66078132s) [noise=true , address=145.79.227.14:4839 , piece_id=KZ7UCSYWUG5S6MDB5KUMZMX22ER4FSYZCZHXUVCRNTNEPRFPU6SQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.858594726 (370h14m35.662059319s) [noise=true , address=145.79.227.5:4222 , piece_id=AE5YN46TA3OOIDO2LHMCBEBLPMRMRIHDR64QXD6HGCINHJWAIJEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.879701307 (370h14m35.683165907s) [noise=true , address=145.79.227.16:4912 , piece_id=F2RTQY4ALBGCGVIZPPZ3WKZRMC4CVIHV2UD4VZNW43MGHITJ3BFA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.883631165 (370h14m35.687095757s) [noise=true , address=145.79.227.13:4803 , piece_id=BKYV46SC6A2KYMHU7HQY2BN36PLGGC7YN2DYKGA7I6F5VDZDODKQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:44:47.905105726 (370h14m35.708570308s) [noise=true , address=145.79.227.6:4259 , piece_id=M6GSWSDYCCS4ZDGPH2UZ6E655F7V74S57KCX55KE4OCTRWETEB4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.189089108 (370h14m54.992553703s) [noise=true , address=45.91.116.12:4225 , piece_id=NVKCJLKFD5QAL3DOQCW7BPTUT3YUZHOGLL7R52XKLP6K3CY76Z7A, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.312744942 (370h14m55.116209531s) [noise=true , address=77.90.31.11:4554 , piece_id=BULPH6CRE5XQ3UHOF2OQX4B557E4KB27CMSVEGWGS7F3K4L4WYSA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:07.899473224 (370h14m55.702937825s) [noise=true , address=45.91.116.7:4011 , piece_id=DB3PSB6POMJPCELXHK3JZ2WK36RLMZYBSIKLC2HXDBWUILLVELDA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:08.498620127 (370h14m56.302084724s) [noise=true , address=45.91.116.14:4191 , piece_id=LDAGYID3QXC52REXG4KQGDMVEVODGC324HXDDLE5RG6RDHNC2I4Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:09.179678264 (370h14m56.983142848s) [noise=true , address=77.90.31.19:4842 , piece_id=4EHS3GMJFJ2PDWWMKGPQOF7FVHBQOFYMALEEY77CK7BCPTLPCXEA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:12.172576799 (370h14m59.976041381s) [noise=true , address=45.91.116.9:4263 , piece_id=5DNIFZYH5XQ4JPXSSBEH43QP4ZYG5JSXMTQRSOGVIDPM6EJFZS6Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427171301 (370h15m4.230635886s) [noise=true , address=45.91.116.11:4119 , piece_id=4YRQZZEKYOAJ4DGPCTHNUWBEH5ZR6UMFN6222XCXIDHEU4RGPURA, seg_pos={0 0}, upload=325729]: Done uploading piece. err: <nil> Oct 8 23:45:16.427206387 (370h15m4.230670978s) [seg_pos={0 0}, upload=325729]: Segment reached optimal threshold of 13 pieces. Oct 8 23:45:16.427507762 (370h15m4.230972341s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427519892 (370h15m4.230984489s) [noise=true , address=77.90.31.11:4555 , piece_id=E3NDVLO6MKC6QVFNP4WDBSP7TGFL3PBHF2H5XRAQJ5QH37SIJ3RQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427615585 (370h15m4.231080163s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Oct 8 23:45:16.427621042 (370h15m4.231085632s) [noise=true , address=45.91.116.10:4083 , piece_id=2H6PTKTZYM5BUB53QUVQZ6TTI6ZUXNNUOCCP7SPKJYJ7LDLDAV7Q, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427627817 (370h15m4.231092409s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: write tcp 139.59.144.22:51230->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 8 23:45:16.427638240 (370h15m4.231102842s) [noise=true , address=45.91.116.4:4939 , piece_id=LCTMD4KPYZCKAWXGY7HUKDTMYY4MSNYFRSI6PLCFBN4IXY6ICBMQ, seg_pos={0 0}, upload=325729]: Long tail cancellation due to optimal threshold Oct 8 23:45:16.427661455 (370h15m4.231126048s) [seg_pos={0 0}, upload=325729]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 8 23:45:16.427765388 (370h15m4.23122998s) [upload=325729]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 23:45:16.427772109 (370h15m4.2312367s) [upload=325729]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 23:45:16.578651028 (370h15m4.382115632s) [upload=325729]: Done uploading segments... Oct 8 23:45:16.578675673 (370h15m4.382140257s) [upload=325729]: Upload finished. err: <nil> Duration: 30.001664809s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.604845811s FAIL (2025-10-08 15:04:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.60487882s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.770221133s FAIL (2025-10-08 15:03:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.770326241s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.794469264s FAIL (2025-10-08 15:03:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.794530789s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.839352058s FAIL (2025-10-08 15:02:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.839408995s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.654402812s FAIL (2025-10-08 15:02:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.654451061s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.148824716s FAIL (2025-10-08 15:01:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.148933799s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.129086308s FAIL (2025-10-08 15:00:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.129117769s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.720583764s FAIL (2025-10-08 14:59:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.720619551s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.550492069s FAIL (2025-10-08 14:58:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.550521536s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.591581515s FAIL (2025-10-08 14:58:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.591613845s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.886070764s FAIL (2025-10-08 14:57:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.886105402s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.782817493s FAIL (2025-10-08 14:56:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.782847198s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.444342506s FAIL (2025-10-08 14:55:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.444510804s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.950603469s FAIL (2025-10-08 14:55:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.95063798s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.82423594s FAIL (2025-10-08 14:54:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.824270375s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.399667659s FAIL (2025-10-08 14:53:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.399708714s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.691751094s FAIL (2025-10-08 14:52:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.691839595s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.737132006s FAIL (2025-10-08 14:51:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.737163019s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.751435464s FAIL (2025-10-08 14:50:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.751465884s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.642831775s FAIL (2025-10-08 14:49:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.642868014s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.857873841s FAIL (2025-10-08 14:49:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.857910226s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.737959399s FAIL (2025-10-08 14:48:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.737992678s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.515722469s FAIL (2025-10-08 14:47:36 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.51575986s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.646408212s FAIL (2025-10-08 14:46:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.646441898s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.984778317s FAIL (2025-10-08 14:46:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.984840082s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.73875744s FAIL (2025-10-08 14:45:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.738784251s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.432373067s FAIL (2025-10-08 14:45:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.432425584s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.115171683s FAIL (2025-10-08 14:43:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.115272226s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.886073339s FAIL (2025-10-08 14:43:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.886105023s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)