Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.341081957s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:11:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.341105897s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 1.640062273s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:11:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.640098509s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.398624195s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:11:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.398656444s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 1.630148792s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:10:29 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.630177086s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 1.923074836s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:10:14 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.923102634s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.477160838s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:10:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.47720053s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 1.580704774s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:09:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.580804088s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 1.65429701s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:09:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.654467535s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.339401933s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:09:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.339436065s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 2.01725185s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:08:41 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.017281366s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.477682146s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:08:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.477712419s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 1.675629858s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:08:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.675650061s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 2.148709051s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:07:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.148733131s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.427107356s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:07:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.427149937s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................X................................] duration: 1.571224299s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:07:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.571260735s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.408884307s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:07:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.408918507s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.413741483s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:06:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.413776395s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................X...............................] duration: 1.742984435s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:06:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.743019841s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................X..............................] duration: 1.617265824s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:06:13 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.617305707s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.430052972s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:06:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.430088011s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.309866833s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:05:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.309921508s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................X.............................] duration: 1.707256806s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:05:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.707281716s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................X............................] duration: 1.580481059s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:05:01 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.580510665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.488897415s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:04:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.488997853s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................X...........................] duration: 1.578474132s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:03:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.578503273s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.397291812s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:03:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.397361995s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................X..........................] duration: 1.695153128s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:03:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.695184885s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.448183897s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:02:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.448218268s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................X.........................] duration: 2.176103164s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:02:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.176133655s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................X........................] duration: 1.67898051s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:01:49 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.679004525s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.492452236s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:01:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.492618097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.464059393s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:01:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.464091091s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 1.552529128s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:01:19 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.552709776s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.659332204s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:00:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.659379364s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 1.776160966s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:00:08 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.776192041s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.367611139s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:59:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.367644582s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.309278929s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:59:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.309307641s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 1.591362605s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:59:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.591452113s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 1.606711417s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:58:41 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.606771751s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 1.582311546s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:58:10 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.582334948s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.389110558s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:58:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.38912757s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 2.144557458s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:57:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.144628837s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.322054209s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:57:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.322086194s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 2.109918904s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:56:46 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.109947376s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.457710037s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:56:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.457735503s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 1.6624391s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:55:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.662469941s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 1.811341068s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:55:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.811370106s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.29534889s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:54:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.295377194s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 1.727371667s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 08:54:29 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.727459953s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.287394624s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 08:54:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.28742427s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)