Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 2.237637611s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:48:12 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.237692313s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 1.61102299s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:47:47 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.611052318s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 1.653469528s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:47:15 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.653497461s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 1.63662386s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:46:55 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.636652174s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 1.599958455s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:46:36 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.600022747s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 1.683912696s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:45:41 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.683945508s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 1.559037464s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:44:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.559065245s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 1.54955226s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:43:32 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.54965168s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.006622787s trace: https://jaeger.dev.storj.io/trace/5c82374a72640e81 FAIL (2026-01-31 10:42:59 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.006709964s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.316396046s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:25:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.316425675s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.322201551s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:24:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.322252238s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 1.6839007s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:24:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.683991416s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.470748127s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:24:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.470770527s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 1.619540321s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:23:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.619711586s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.337538897s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:23:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.33758517s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.442610486s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:23:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.442634961s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 1.787759705s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:23:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.78784783s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 1.692773092s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:23:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.692801494s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.401854687s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:22:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.40188809s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 1.685335531s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:21:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.685359998s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.47133657s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:21:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.471364367s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 2.230664602s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:21:07 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.231228358s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 1.728314761s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:20:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.728340574s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.355655312s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:20:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.355704563s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.396683725s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:20:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.396766597s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 1.638195515s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:19:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.63822569s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.431502029s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:19:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.431526212s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 1.565130258s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:19:23 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.565181807s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.384150221s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:19:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.384176505s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 1.554481907s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:18:59 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.554537274s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.295815342s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:18:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.295863731s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 1.680941841s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:18:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.680968933s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.417745971s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:17:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.417791584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.431409363s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:17:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.43143957s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 2.176151688s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:17:21 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.176178354s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.515652263s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:16:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.515679996s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 1.545238298s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:16:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.545269445s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.542550458s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:16:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.542583134s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.376071535s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:15:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.376103738s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 1.571740237s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:15:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.571765805s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.454155534s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:14:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.454241664s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 1.594362701s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:14:34 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.594455843s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.438110974s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:14:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.438135416s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 1.60971543s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:14:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.609975329s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.335832024s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:13:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.33586085s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 1.615507899s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:13:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.615545404s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.445717284s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:12:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.445746447s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 1.568607574s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:12:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.56864772s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.298519911s trace: https://jaeger.dev.storj.io/trace/23a894bec03565a0 FAIL (2026-01-31 09:12:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments... Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment... Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment. Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece... Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments... Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil> Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments... Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.298608665s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 1.612739567s trace: https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52 FAIL (2026-01-31 09:11:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.61301142s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)