Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
1.734697714s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:47:29 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.734726393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.389798897s trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:46:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.389829928s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.347043772s trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:46:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.34713147s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
1.634986986s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:46:18 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.635058835s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.461695614s trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:45:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.461818053s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.501080493s trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:45:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.501102709s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
3m12.296697629s trace:
https://jaeger.dev.storj.io/trace/23a894bec03565a0
FAIL (2026-01-31 08:45:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Jan 31 08:42:01.789851100 (376h46m39.673805306s) [upload=331392]: Starting upload
Jan 31 08:42:01.789981327 (376h46m39.673935596s) [upload=331392]: Done starting upload
Jan 31 08:42:01.790185691 (376h46m39.674139908s) [upload=331392]: Uploading segments...
Jan 31 08:42:01.790938684 (376h46m39.674892897s) [upload=331392]: Got next segment. Inline: false
Jan 31 08:42:01.791043903 (376h46m39.674998105s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 31 08:42:01.791051806 (376h46m39.675006008s) [upload=331392]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 31 08:42:01.911242697 (376h46m39.795196903s) [seg_pos={0 0}, upload=331392]: Begin upload segment...
Jan 31 08:42:01.911328906 (376h46m39.795283104s) [seg_pos={0 0}, upload=331392]: Done begin upload segment.
Jan 31 08:42:01.911380187 (376h46m39.795334391s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.912975034 (376h46m39.796929241s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.913686698 (376h46m39.797640909s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.914643113 (376h46m39.798597322s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915250444 (376h46m39.799204654s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.915819861 (376h46m39.799774079s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916348907 (376h46m39.80030312s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.916791501 (376h46m39.800745712s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917271323 (376h46m39.80122552s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.917718678 (376h46m39.801672881s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.918652300 (376h46m39.80260651s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.922588049 (376h46m39.806542271s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.923713593 (376h46m39.807667816s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.928803315 (376h46m39.812757529s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.936692202 (376h46m39.820646417s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:01.940819309 (376h46m39.824773519s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Uploading piece...
Jan 31 08:42:02.576285773 (376h46m40.460239987s) [upload=331392]: Next returned nil segment
Jan 31 08:42:02.576308965 (376h46m40.460263178s) [upload=331392]: Waiting for error group managing segments...
Jan 31 08:42:02.709544490 (376h46m40.593498692s) [noise=true , address=145.79.227.41:4087 , piece_id=FOIIMSHSEDH2RKLDEWYYRASBXEGTPUADDTB4ILRMYK47BAHGIYHQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.709563318 (376h46m40.593517531s) [noise=true , address=145.79.227.30:4761 , piece_id=TNRZ4DNZ7EOC2XBQMN7N7LTLOAS5RJRHXNJ4FWI4VVHVTQIH7TNA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711717290 (376h46m40.595671528s) [noise=true , address=145.79.227.35:4482 , piece_id=5Q2S6LBYBGCYGLG3QAGRZ3JH67X5NQDMH33MTULALZFJGL44FI3Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.711868099 (376h46m40.595822301s) [noise=true , address=145.79.227.40:4049 , piece_id=YAFMACQQ5FPKWLK3I3AE3MTEBBUQDAQBGDV3Q4QHPUWCQOI3CXXA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.713287655 (376h46m40.597241855s) [noise=true , address=145.79.227.50:4373 , piece_id=XQK2FMRBPZRT6WCXVVGBW24VOKEKFDEYRXAXWJTBJMNTDXZPHFZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.719849384 (376h46m40.603803633s) [noise=true , address=145.79.227.29:4941 , piece_id=PA3266WO3G2AGUXSDY6HUPOMYCMJZ4GLHDR53MVVZUTEHQKDJ2TQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720101996 (376h46m40.604056206s) [noise=true , address=145.79.227.36:4517 , piece_id=NCZRNCK4G4Q3OOLKK6ED3M6GWYZMV6NDU77FNC2CMOJATIMLQUEQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.720607122 (376h46m40.604561323s) [noise=true , address=77.90.31.18:4805 , piece_id=SHP65QQIG5HQ4MKCFJTJVEGBFA55242K56ZWGFMWXJFX5UXGDC7Q, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.721889317 (376h46m40.605843529s) [noise=true , address=145.79.227.37:4565 , piece_id=ULDUN3OXRCVM5MEZTTFEHGSSBB4UTL6DQSOKL3KOQUTQ2RXP3PRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.723706661 (376h46m40.607660883s) [noise=true , address=77.90.31.10:4520 , piece_id=6P7USYWYOFITEIZ4WEHJUOWDOFWHRWMRHU436ZBX6Q7F5ZXTOYOA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:02.728218410 (376h46m40.612172617s) [noise=true , address=145.79.227.36:4518 , piece_id=ZFUFCRLNFEE5D2H2QM3GM5OPZI5EB5PGEAHETEJAR5YLUE2IKU5A, seg_pos={0 0}, upload=331392]: Done uploading piece. err: <nil>
Jan 31 08:42:31.479670446 (376h47m9.36362465s) [noise=true , address=45.91.116.8:4070 , piece_id=HABKL5QHQF4OBHLPBEYXXWICSXADUKLWG636Q6BSZLXRQM3HBAMA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12qpELr7Yr1aJtgau8q34qPBtADW6QAXPNySAzcRLB39hXoXueo, address:45.91.116.8:4070): protocol: write tcp 139.59.144.22:58792->45.91.116.8:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479759109 (376h47m9.363713317s) [noise=true , address=45.91.116.14:4189 , piece_id=C7QNF3DAXLYVRKRGXAG7QEVCO4WC7XSWUARPHDO2GUXWUCMJJVAQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:39448->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479838885 (376h47m9.363793087s) [noise=true , address=45.91.116.13:4153 , piece_id=53BKBAIWUZAKVJHTMPRFXFAC7LZHLWAKJR2W7E2JEFDDQXTPEBRA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 139.59.144.22:40790->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.479993304 (376h47m9.363947513s) [noise=true , address=45.91.116.12:4226 , piece_id=CUIC24TAWWLVPEIXZZA7KG46OS6O3TCYIDBBSHUTTHJXXZFVHDZA, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:40556->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480028335 (376h47m9.363982538s) [noise=true , address=45.91.116.5:4297 , piece_id=WPY6AXBMXTIGRRZEQ4HDTZ6QTQ7OQTHIP3U4LXLLBM6UES5MOTLQ, seg_pos={0 0}, upload=331392]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 139.59.144.22:34268->45.91.116.5:4297: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 31 08:42:31.480079759 (376h47m9.364033962s) [seg_pos={0 0}, upload=331392]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jan 31 08:45:13.774445565 (376h49m51.658399767s) [upload=331392]: Done uploading segments...
Jan 31 08:45:13.774472914 (376h49m51.658427113s) [upload=331392]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 3m12.296723006s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
1.735628834s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:45:06 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.735687483s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
1.63441206s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:44:23 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.634439456s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
2.234376579s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:43:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.234400237s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
1.680868071s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:42:32 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.68089883s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.001641736s trace:
https://jaeger.dev.storj.io/trace/2f6086d9b9c63b52
FAIL (2026-01-31 08:42:09 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001663064s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
1.699052803s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:24:42 UTC)
orbiter warning: context deadline exceeded
Duration: 1.699079476s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
1.671721089s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:23:36 UTC)
orbiter warning: context deadline exceeded
Duration: 1.671751104s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
1.669525909s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:22:24 UTC)
orbiter warning: context deadline exceeded
Duration: 1.669555661s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
1.713404226s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:22:04 UTC)
orbiter warning: context deadline exceeded
Duration: 1.713428389s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
1.618836991s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:21:29 UTC)
orbiter warning: context deadline exceeded
Duration: 1.618866124s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.710657465s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:20:35 UTC)
orbiter warning: context deadline exceeded
Duration: 1.710677824s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.771578213s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:19:58 UTC)
orbiter warning: context deadline exceeded
Duration: 1.771616252s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
1.656168956s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:19:34 UTC)
orbiter warning: context deadline exceeded
Duration: 1.656217663s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
1.725049103s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:18:52 UTC)
orbiter warning: context deadline exceeded
Duration: 1.72513496s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
2.098312301s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:18:19 UTC)
orbiter warning: context deadline exceeded
Duration: 2.098382199s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.643265487s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:17:25 UTC)
orbiter warning: context deadline exceeded
Duration: 1.643294292s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
1.665672169s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:16:33 UTC)
orbiter warning: context deadline exceeded
Duration: 1.665698751s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.772931675s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:15:30 UTC)
orbiter warning: context deadline exceeded
Duration: 1.772967519s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.70245759s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:14:36 UTC)
orbiter warning: context deadline exceeded
Duration: 1.702494086s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
1.684533331s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:13:29 UTC)
orbiter warning: context deadline exceeded
Duration: 1.684562846s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.610630071s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:12:45 UTC)
orbiter warning: context deadline exceeded
Duration: 1.610661897s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
1.66514974s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:11:57 UTC)
orbiter warning: context deadline exceeded
Duration: 1.665182092s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
1.608404852s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:11:05 UTC)
orbiter warning: context deadline exceeded
Duration: 1.608457126s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.624667842s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:10:27 UTC)
orbiter warning: context deadline exceeded
Duration: 1.624698986s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.709896096s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:09:29 UTC)
orbiter warning: context deadline exceeded
Duration: 1.709919444s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.607270989s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:09:06 UTC)
orbiter warning: context deadline exceeded
Duration: 1.607291484s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
1.651953483s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:08:33 UTC)
orbiter warning: context deadline exceeded
Duration: 1.651982072s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
1.660836833s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:08:01 UTC)
orbiter warning: context deadline exceeded
Duration: 1.660873558s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
1.700415602s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:07:39 UTC)
orbiter warning: context deadline exceeded
Duration: 1.700502753s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
1.53064047s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:07:20 UTC)
orbiter warning: context deadline exceeded
Duration: 1.53067416s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
2.21181357s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:07:02 UTC)
orbiter warning: context deadline exceeded
Duration: 2.212165622s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
1.720384218s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:06:03 UTC)
orbiter warning: context deadline exceeded
Duration: 1.720464682s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
1.726608483s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:05:28 UTC)
orbiter warning: context deadline exceeded
Duration: 1.726701671s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.590958638s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:04:38 UTC)
orbiter warning: context deadline exceeded
Duration: 1.590987853s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.649381089s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:03:36 UTC)
orbiter warning: context deadline exceeded
Duration: 1.649435642s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
1.618318544s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:03:19 UTC)
orbiter warning: context deadline exceeded
Duration: 1.618356846s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.683511963s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:02:20 UTC)
orbiter warning: context deadline exceeded
Duration: 1.683540338s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.781807205s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:01:41 UTC)
orbiter warning: context deadline exceeded
Duration: 1.781829314s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
1.611860982s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 20:00:32 UTC)
orbiter warning: context deadline exceeded
Duration: 1.611957503s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
1.720501966s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 19:59:58 UTC)
orbiter warning: context deadline exceeded
Duration: 1.720535951s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
1.741502284s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 19:59:27 UTC)
orbiter warning: context deadline exceeded
Duration: 1.741528117s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
2.181384068s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 19:59:01 UTC)
orbiter warning: context deadline exceeded
Duration: 2.181410971s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
1.626918808s trace:
https://jaeger.dev.storj.io/trace/38c41541c940491f
FAIL (2026-01-30 19:57:45 UTC)
orbiter warning: context deadline exceeded
Duration: 1.626949786s
core
uplink
us-select-1
us1-placement-20
|