Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [XXX.XXXXX.XXXX.X............................................] duration: 479.313738ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:23:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 479.378727ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [XXXX.XXXXX.XXXX.X...........................................] duration: 898.567653ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:23:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 898.663772ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.333459531s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:23:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.333486745s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..............X..........] duration: 2.802230419s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:22:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.802255529s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..............X.........] duration: 2.769905334s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:22:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.770048936s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [XXXXX.XXXXX.XXXX.X..........................................] duration: 911.931732ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:22:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 911.973435ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.354523715s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:22:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.354557638s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..............X........] duration: 2.749376927s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:21:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.74975702s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..............X.......] duration: 2.775627482s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:21:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.775652774s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [XXXXXX.XXXXX.XXXX.X.........................................] duration: 907.167203ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:21:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 907.281258ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.357159217s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:21:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.357189533s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..............X......] duration: 2.821491676s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:20:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.821521322s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.425534217s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:20:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.425569892s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 17 out of 60 is failed (threshold=3) [XXXXXXX.XXXXX.XXXX.X........................................] duration: 901.198275ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:20:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 901.219084ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..............X.....] duration: 2.723288035s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:19:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723319722s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.449529191s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:19:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.449559085s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..............X....] duration: 2.656751766s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:19:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.65677916s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..............X...] duration: 2.556211962s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:19:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.556301025s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 18 out of 60 is failed (threshold=3) [XXXXXXXX.XXXXX.XXXX.X.......................................] duration: 899.417184ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:18:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 899.520183ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 19 out of 60 is failed (threshold=3) [XXXXXXXXX.XXXXX.XXXX.X......................................] duration: 516.482157ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:18:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 516.655057ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.432407725s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:18:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.43243629s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.362771104s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:17:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.362830277s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..............X..] duration: 2.640759534s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:17:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.640825183s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 20 out of 60 is failed (threshold=3) [XXXXXXXXXX.XXXXX.XXXX.X.....................................] duration: 943.102094ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:17:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 943.13104ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.389524786s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:17:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.389554851s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 21 out of 60 is failed (threshold=3) [XXXXXXXXXXX.XXXXX.XXXX.X....................................] duration: 920.743237ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:16:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 920.775448ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..............X.] duration: 2.560464197s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:16:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.560490249s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.359020671s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:16:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.359047642s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 16.300020352s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:16:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 16.300076787s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..............X] duration: 30.001407126s trace: https://jaeger.dev.storj.io/trace/1f199c432f4f49ec FAIL (2026-01-28 13:16:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001489586s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 22 out of 60 is failed (threshold=3) [XXXXXXXXXXXX.XXXXX.XXXX.X...................................] duration: 451.81258ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:15:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 451.847667ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.405074797s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:14:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.405103076s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.818112032s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:14:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.818141591s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XXXXX.XXXX.X..................................] duration: 899.094896ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:14:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 899.175857ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.475712067s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:14:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.475742439s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.881350846s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:14:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.881374431s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXX.XXXXX.XXXX.X.................................] duration: 455.881175ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:14:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 455.905063ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXX.XXXXX.XXXX.X................................] duration: 862.193622ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:13:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 862.224946ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.310607754s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:13:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.310637359s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.745898536s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:13:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.745920718s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.412889229s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:13:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.412920217s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.805141165s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:12:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.805167809s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXX.XXXXX.XXXX.X...............................] duration: 907.353224ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:12:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 907.38452ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.556482796s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:12:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.556509367s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.654634414s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:12:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.654659737s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.293271585s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:11:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.293302962s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXX.XXXXX.XXXX.X..............................] duration: 955.556065ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:11:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 955.604966ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.694244394s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:11:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.694273527s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.388659728s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:11:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.38868835s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXX.XXXXX.XXXX.X.............................] duration: 923.44073ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:11:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 923.467355ms core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)