Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 501.441564ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:35:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 501.516599ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X..............X.............................] duration: 2.852126384s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:35:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.85215184s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 839.866352ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:35:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 839.913722ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.342530681s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:35:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.342560591s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X..............X............................] duration: 2.950758022s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:35:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.950853227s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X..............X...........................] duration: 2.641326262s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:34:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.641361381s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.361552744s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:34:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.361581081s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 961.7372ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:34:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 961.831832ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X..............X..........................] duration: 2.693888403s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:33:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.69391132s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.26849079s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:33:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.268521563s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.351238785s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:33:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.351270125s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X..............X.........................] duration: 2.515616448s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:33:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.515642656s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [XX.X........................................................] duration: 481.39535ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:33:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 481.427931ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.554079138s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:32:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.554110203s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X..............X........................] duration: 2.527569989s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:32:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.527600833s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..............X.......................] duration: 2.751515526s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:31:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.751534426s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [XXX.X.......................................................] duration: 917.646364ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:31:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 917.680997ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X..............X......................] duration: 2.648614636s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:31:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.648648175s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [XXXX.X......................................................] duration: 978.741231ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:31:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 978.807558ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.337897596s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:31:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.337929029s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..............X.....................] duration: 2.729255759s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:31:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.729367826s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.XXXX.X.....................................................] duration: 435.222601ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:30:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 435.300621ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.349611143s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:30:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.349637197s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X..............X....................] duration: 2.873055409s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:30:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.873085136s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..............X...................] duration: 2.736063239s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:29:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.736086817s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.360876404s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:29:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.360905874s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 6 out of 60 is failed (threshold=3) [X.XXXX.X....................................................] duration: 487.384153ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:29:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 487.479433ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..............X..................] duration: 2.86690596s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:29:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.866933248s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 7 out of 60 is failed (threshold=3) [XX.XXXX.X...................................................] duration: 909.351723ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:29:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 909.384777ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 8 out of 60 is failed (threshold=3) [XXX.XXXX.X..................................................] duration: 469.426662ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:28:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 469.453737ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.324383061s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:28:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.32440511s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..............X.................] duration: 2.503496629s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:27:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.503519103s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 9 out of 60 is failed (threshold=3) [XXXX.XXXX.X.................................................] duration: 899.579773ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:27:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 899.608722ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X..............X................] duration: 2.863281726s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:27:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.863304516s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.449224918s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:27:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.44924597s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.491606403s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:26:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.491631464s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..............X...............] duration: 2.468036687s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:26:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.468064539s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 10 out of 60 is failed (threshold=3) [XXXXX.XXXX.X................................................] duration: 611.502575ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:26:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 611.529587ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.318420658s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:26:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.318456329s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.363340381s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:25:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.363363982s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 10 out of 60 is failed (threshold=3) [.XXXXX.XXXX.X...............................................] duration: 918.830287ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:25:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 918.861199ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..............X..............] duration: 2.947096592s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:25:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.947125556s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.329988419s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:25:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.330016913s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [X.XXXXX.XXXX.X..............................................] duration: 472.437315ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:25:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 472.528423ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.35736808s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:24:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.357400278s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 12 out of 60 is failed (threshold=3) [XX.XXXXX.XXXX.X.............................................] duration: 867.373928ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:24:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 867.403419ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..............X.............] duration: 2.767512806s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:24:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.767541209s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X..............X............] duration: 2.650148704s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:23:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.650220316s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.43092675s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:23:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.430967856s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..............X...........] duration: 2.669840402s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:23:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.669885991s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)