Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 197291 reports (Page 89 of 3946)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
2.440584431s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:54:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.440637969s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............]
duration:
1.623005179s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:53:58 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.623036104s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
2.340507233s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:53:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.340536999s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
2.288899237s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:53:30 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.288928427s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............]
duration:
1.555334728s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:53:02 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.555361754s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
2.453604041s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:52:25 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.453656118s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........]
duration:
1.756421707s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:51:48 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.756441738s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
2.461872289s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:51:23 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.461906605s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........]
duration:
1.608426124s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:50:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.608448961s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
2.319410661s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:50:31 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.319455368s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........]
duration:
1.819857511s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:49:32 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.819896311s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
2.436265539s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:49:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.43629741s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........]
duration:
1.662738901s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:49:11 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.662778799s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
2.267290886s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:48:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.267316081s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......]
duration:
1.857563071s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:48:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.857614844s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
2.417896613s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:48:16 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.417935273s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.38622924s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:47:48 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.386341981s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......]
duration:
1.734697714s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:47:29 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.734726393s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.389798897s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:46:43 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.389829928s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.347043772s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:46:19 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.34713147s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....]
duration:
1.634986986s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:46:18 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.635058835s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
2.461695614s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:45:54 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.461818053s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
2.501080493s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:45:16 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.501102709s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
3m12.296697629s
trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:45:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087   , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761   , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482   , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049   , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373   , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941   , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517   , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805     , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565   , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520     , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518   , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070     , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189    , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153    , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226    , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297     , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 3m12.296723006s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....]
duration:
1.735628834s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:45:06 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.735687483s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...]
duration:
1.63441206s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:44:23 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.634439456s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..]
duration:
2.234376579s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:43:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.234400237s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.]
duration:
1.680868071s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:42:32 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.68089883s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X]
duration:
5.001641736s
trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:42:09 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001663064s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................]
duration:
1.699052803s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:24:42 UTC)
orbiter warning: context deadline exceeded
Duration: 1.699079476s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................]
duration:
1.671721089s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:23:36 UTC)
orbiter warning: context deadline exceeded
Duration: 1.671751104s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................]
duration:
1.669525909s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:22:24 UTC)
orbiter warning: context deadline exceeded
Duration: 1.669555661s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................]
duration:
1.713404226s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:22:04 UTC)
orbiter warning: context deadline exceeded
Duration: 1.713428389s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................]
duration:
1.618836991s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:21:29 UTC)
orbiter warning: context deadline exceeded
Duration: 1.618866124s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................]
duration:
1.710657465s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:20:35 UTC)
orbiter warning: context deadline exceeded
Duration: 1.710677824s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................]
duration:
1.771578213s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:19:58 UTC)
orbiter warning: context deadline exceeded
Duration: 1.771616252s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................]
duration:
1.656168956s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:19:34 UTC)
orbiter warning: context deadline exceeded
Duration: 1.656217663s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................]
duration:
1.725049103s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:18:52 UTC)
orbiter warning: context deadline exceeded
Duration: 1.72513496s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................]
duration:
2.098312301s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:18:19 UTC)
orbiter warning: context deadline exceeded
Duration: 2.098382199s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................]
duration:
1.643265487s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:17:25 UTC)
orbiter warning: context deadline exceeded
Duration: 1.643294292s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................]
duration:
1.665672169s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:16:33 UTC)
orbiter warning: context deadline exceeded
Duration: 1.665698751s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................]
duration:
1.772931675s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:15:30 UTC)
orbiter warning: context deadline exceeded
Duration: 1.772967519s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................]
duration:
1.70245759s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:14:36 UTC)
orbiter warning: context deadline exceeded
Duration: 1.702494086s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................]
duration:
1.684533331s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:13:29 UTC)
orbiter warning: context deadline exceeded
Duration: 1.684562846s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................]
duration:
1.610630071s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:12:45 UTC)
orbiter warning: context deadline exceeded
Duration: 1.610661897s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................]
duration:
1.66514974s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:11:57 UTC)
orbiter warning: context deadline exceeded
Duration: 1.665182092s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................]
duration:
1.608404852s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:11:05 UTC)
orbiter warning: context deadline exceeded
Duration: 1.608457126s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................]
duration:
1.624667842s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:10:27 UTC)
orbiter warning: context deadline exceeded
Duration: 1.624698986s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................]
duration:
1.709896096s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:09:29 UTC)
orbiter warning: context deadline exceeded
Duration: 1.709919444s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................]
duration:
1.607270989s
trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:09:06 UTC)
orbiter warning: context deadline exceeded
Duration: 1.607291484s core uplink us-select-1 us1-placement-20