Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.405074797s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:14:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.405103076s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.818112032s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:14:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.818141591s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XXXXX.XXXX.X..................................] duration: 899.094896ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:14:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 899.175857ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.475712067s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:14:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.475742439s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.881350846s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:14:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.881374431s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXX.XXXXX.XXXX.X.................................] duration: 455.881175ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:14:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 455.905063ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXX.XXXXX.XXXX.X................................] duration: 862.193622ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:13:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 862.224946ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.310607754s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:13:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.310637359s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.745898536s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:13:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.745920718s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.412889229s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:13:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.412920217s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.805141165s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:12:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.805167809s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXX.XXXXX.XXXX.X...............................] duration: 907.353224ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:12:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 907.38452ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.556482796s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:12:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.556509367s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.654634414s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:12:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.654659737s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.293271585s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:11:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.293302962s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXX.XXXXX.XXXX.X..............................] duration: 955.556065ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:11:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 955.604966ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.694244394s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:11:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.694273527s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.388659728s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:11:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.38868835s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXX.XXXXX.XXXX.X.............................] duration: 923.44073ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:11:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 923.467355ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXX.XXXXX.XXXX.X............................] duration: 915.840965ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:10:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 915.865877ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 19.013608378s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:10:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 19.01364259s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.......XXXXXXXXXXXXX.XXXXX.XXXX.X...........................] duration: 466.165248ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:10:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 466.260047ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.134034832s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:10:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.134064171s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [........XXXXXXXXXXXXX.XXXXX.XXXX.X..........................] duration: 541.50366ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:09:25 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 541.546587ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.735529834s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:09:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.735705397s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.28248321s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:08:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.282512203s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXX.XXXXX.XXXX.X.........................] duration: 467.325698ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:08:55 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 467.358158ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.497323549s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:08:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.497355169s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.339383449s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:08:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.339410558s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.624352008s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:07:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.624380423s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.396816349s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:07:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.396845024s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [..........XXXXXXXXXXXXX.XXXXX.XXXX.X........................] duration: 515.859956ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:07:43 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 515.887585ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.686629786s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:07:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.686654638s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.529374506s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:06:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.529403695s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.965981686s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:06:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.966030517s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 17.814431188s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:06:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 17.814473357s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 11.355751552s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:06:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 11.355800013s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.108439147s trace: https://jaeger.dev.storj.io/trace/53e8d67461bbf78d FAIL (2026-01-28 13:06:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8 13:05:31.883342071 (309h10m9.767296272s) [upload=271958]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 13:05:31.883348453 (309h10m9.767302653s) [upload=271958]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 13:05:31.996634489 (309h10m9.880588701s) [seg_pos={0 0}, upload=271958]: Begin upload segment... Jan 28 13:05:31.996724601 (309h10m9.880678801s) [seg_pos={0 0}, upload=271958]: Done begin upload segment. Jan 28 13:05:31.996785593 (309h10m9.880739803s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997859169 (309h10m9.881813394s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.997937051 (309h10m9.88189125s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998518343 (309h10m9.882472551s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.998549400 (309h10m9.88250361s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999029231 (309h10m9.882983434s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999174764 (309h10m9.883128979s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999473418 (309h10m9.88342762s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999780432 (309h10m9.883734646s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:31.999881185 (309h10m9.883835387s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000340054 (309h10m9.884294264s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.000419244 (309h10m9.884373478s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001029490 (309h10m9.884983701s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001074267 (309h10m9.885028476s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001445329 (309h10m9.885399529s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.001655172 (309h10m9.885609383s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002346545 (309h10m9.886300759s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.002905193 (309h10m9.886859406s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Uploading piece... Jan 28 13:05:32.551958843 (309h10m10.435913044s) [upload=271958]: Next returned nil segment Jan 28 13:05:32.551976984 (309h10m10.435931201s) [upload=271958]: Waiting for error group managing segments... Jan 28 13:05:32.699832176 (309h10m10.583786376s) [noise=true , address=77.90.31.12:4593 , piece_id=JG54LS4G6JMLBPWHQ3RPIDZNVWAOW4X246JXJVJIYC6BAJNFS3KA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.702059068 (309h10m10.586013278s) [noise=true , address=77.90.31.18:4825 , piece_id=WGYCUVSFGUYVXU4LLLGFTFJS3W357G7VJZRKR6Z5UF3R4PBWFKTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.706506835 (309h10m10.590461035s) [noise=true , address=77.90.31.17:4803 , piece_id=ARHK7KRZCODQN3XJEGCTL3M5LNQW6FFT6TRVCTRKWH425NB7MO2Q, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.712365935 (309h10m10.596320134s) [noise=true , address=77.90.31.16:4761 , piece_id=UODSH2ETUJ7L5JNOM44FFKA753RUFWDLDWOOXIBHQQKKXX5C5D3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.713349197 (309h10m10.5973034s) [noise=true , address=77.90.31.15:4723 , piece_id=RRY7NXY3DLZ7LF2SAEPI6M322GD4AKSSNY3SEUD5OMUVH6STAS3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.721539275 (309h10m10.605493482s) [noise=true , address=77.90.31.10:4549 , piece_id=REYSZJYOGN66FP2SD4ZBGYCEDKWNDSOXGTIMYNX32BAK6JQO7AYA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.732905032 (309h10m10.616859233s) [noise=true , address=79.127.219.46:4917 , piece_id=AR5DIDEMTDW3XFHTUIJPHSSLLGPYIAOQBOQ6SJYNOCGEKNBUF4OQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.743449899 (309h10m10.627404099s) [noise=true , address=79.127.219.38:4852 , piece_id=M2MFRISJO5MX3S5W3SYAHD7GBMQ3YDD3S6TZHU5H5MTEHUA7UTQA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.745338693 (309h10m10.629292895s) [noise=true , address=79.127.219.41:4935 , piece_id=AHYSXBTAOZZH5WKFU3AM67YQYIFNMYFCHDG6GBXZJ4LRJ3MGPLIQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.754181398 (309h10m10.638135587s) [noise=true , address=79.127.219.45:4868 , piece_id=I3MXB3QNRTOLYG3QAWSKFJOHB27XH3L3XBE36ROQ5NQLTT4AHD3A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:32.792292808 (309h10m10.676247007s) [noise=true , address=77.90.31.13:4642 , piece_id=L6V5AOTCBDCDV75SFZKVPPB2SWC3BXTMRDIY32G6PIE3RAZT43JQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.232365878 (309h10m11.116320067s) [noise=true , address=64.49.13.27:4968 , piece_id=WKQVPADHGYFWFW6KZTVO5MRHKUJFIIOWGTT7IXWD6COLUTJWTAHQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:05:33.238638338 (309h10m11.122592538s) [noise=true , address=64.49.13.169:4706 , piece_id=CKBECIMEBUZJA2D2DP24SP54EVSBSKLAV56BKYTVCCA5JSG2LCTQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: <nil> Jan 28 13:06:31.583244825 (309h11m9.467199035s) [noise=true , address=45.91.116.6:4997 , piece_id=6ARETYERZSNCAMZ6OE64UBPMOSOFZOHZHRDW6OEW57YFG6SLI7IQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p, address:45.91.116.6:4997): protocol: read tcp 139.59.144.22:35402->45.91.116.6:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583388126 (309h11m9.467342331s) [noise=true , address=45.91.116.13:4165 , piece_id=NFO7X3D5NGBDEVZVRLKHZLJOFRWDGYO3AVF5ANC4LIOC4JR22NAA, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:12XR8ACsXNSFvcZU3boexUojKn2Mr2i7fAbBC6aQ6imCH995HKg, address:45.91.116.13:4165): protocol: read tcp 139.59.144.22:41666->45.91.116.13:4165: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583710127 (309h11m9.467664333s) [noise=true , address=45.91.116.4:4963 , piece_id=LM2EFUP63FQJL7O26NYHNGGEAQPU5QCESYXNMEFK2UZIPY42MQKQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: read tcp 139.59.144.22:59384->45.91.116.4:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583763387 (309h11m9.467717595s) [noise=true , address=45.91.116.5:4305 , piece_id=C5YVNNQCZDVYSTUAFIHIBTGLQAYWQ4Z6BVPTN3LILMPY76YML2YQ, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 139.59.144.22:45336->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583934510 (309h11m9.467888718s) [noise=true , address=45.91.116.9:4266 , piece_id=EJYEZ37PSRKF75X7Q6YKK2TV2QH3FMENXN2WHWDZUWAXFS24B54A, seg_pos={0 0}, upload=271958]: Done uploading piece. err: ecclient: upload failed (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k, address:45.91.116.9:4266): protocol: read tcp 139.59.144.22:57280->45.91.116.9:4266: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 13:06:31.583974908 (309h11m9.467929109s) [seg_pos={0 0}, upload=271958]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jan 28 13:06:31.689448045 (309h11m9.573402253s) [upload=271958]: Done uploading segments... Jan 28 13:06:31.689492270 (309h11m9.573446482s) [upload=271958]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.108466862s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [...........XXXXXXXXXXXXX.XXXXX.XXXX.X.......................] duration: 465.1322ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:06:28 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 465.160666ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001431487s trace: https://jaeger.dev.storj.io/trace/718b3bdf2de7e745 FAIL (2026-01-28 13:06:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001449377s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXX.XXXXX.XXXX.X......................] duration: 851.979035ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:05:54 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 852.023962ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXX.XXXXX.XXXX.X.....................] duration: 431.646239ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:05:12 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 431.673426ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXX.XXXXX.XXXX.X....................] duration: 563.48199ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:04:53 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 563.50752ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXX.XXXXX.XXXX.X...................] duration: 566.99904ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:04:37 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 567.02276ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXX.XXXXX.XXXX.X..................] duration: 480.420678ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:03:54 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 480.449316ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXX.XXXXX.XXXX.X.................] duration: 542.318011ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:03:37 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 542.347973ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXX.XXXXX.XXXX.X................] duration: 920.726432ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:02:55 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 920.819881ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXX.XXXXX.XXXX.X...............] duration: 1.145585433s trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:02:02 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1.146116735s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXX.XXXXX.XXXX.X..............] duration: 1.115339626s trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:01:27 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1.11537099s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXX.XXXXX.XXXX.X.............] duration: 593.105402ms trace: https://jaeger.dev.storj.io/trace/6677add78abdf233 FAIL (2026-01-28 13:00:12 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9579408s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.487338362 (308h58m39.371292575s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.494273859 (308h58m39.378228069s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.496289209 (308h58m39.38024342s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.497689987 (308h58m39.381644209s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.500368580 (308h58m39.384322791s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.502569391 (308h58m39.386523595s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.512083801 (308h58m39.396038017s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.515140572 (308h58m39.399094783s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.517383835 (308h58m39.401338047s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.520677199 (308h58m39.404631413s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.522894513 (308h58m39.406848725s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Uploading piece... Jan 28 12:54:01.541871883 (308h58m39.425826107s) [noise=true , address=185.167.204.205:4008 , piece_id=7FKVKCUNGYHEIMUF63PHDQRH7F26H5OKCQ32OMMMJJKVA4DBYBMA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: rpc: dial tcp 185.167.204.205:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:54:01.649136347 (308h58m39.533090538s) [upload=271774]: Next returned nil segment Jan 28 12:54:01.649155538 (308h58m39.533109747s) [upload=271774]: Waiting for error group managing segments... Jan 28 12:54:01.668837458 (308h58m39.552791671s) [noise=true , address=89.149.201.147:4007 , piece_id=G4QNYCKL4ORLPX2KCGNFBH6RFMIXFWAJSBCP75CEOOWAZUDXX6GQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.676440835 (308h58m39.560395046s) [noise=true , address=89.149.201.147:4024 , piece_id=HGD7WGPUXVLKEAGQVFK6M4ULJJ2J6A7MQAT43AQJKDSITH565QVQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.677419848 (308h58m39.561374056s) [noise=true , address=89.149.201.147:4023 , piece_id=I3Z7WMH2JAFOM4PG5OE4JOLOHPR2KLIC3NAQ2BP72IFFNFDLTDXA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.678112478 (308h58m39.56206668s) [noise=true , address=89.149.201.147:4012 , piece_id=EDHFOCG62HBZPILTLCWC7T5MQID654GWN4AUZ555ZWVNNYWIES2Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.680694568 (308h58m39.564648779s) [noise=true , address=185.167.204.206:4040 , piece_id=QO6I4TOUHXSB45MYP623A7KXL2VSYS7W44KWSNXANLL4SZSPZB7A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681244338 (308h58m39.565198542s) [noise=true , address=89.149.201.147:4004 , piece_id=CU66V47LCSKW5SAAVDHVJ7VCB6ZCKJFMMANG56ADV4ZZVAQUPPEA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.681699717 (308h58m39.565653925s) [noise=true , address=185.167.204.205:4025 , piece_id=QW4OPI35JCGUZGL6MTAHE7EEM4CGU34HDHZD53LTCWYH27MALDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.683708115 (308h58m39.567662318s) [noise=true , address=81.171.14.70:4035 , piece_id=BM3RIMZTII3AM4UNI57MSHOIJB4YXHPY5V2733IWVCHCXWRJJ6PQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.685353632 (308h58m39.569307833s) [noise=true , address=185.167.204.205:4035 , piece_id=3NSMHM3I3FT33LL3GTDZPC7UTGEMHD3536Z3MJSXFTPGQTRMJUDA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688813972 (308h58m39.572768181s) [noise=true , address=81.171.14.70:4048 , piece_id=ZWMNYOMHTRMS4HWXCH6PXOKT2YQHN3ZS6J7E2ZYQ44NGDDZJYPYA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.688849068 (308h58m39.572803279s) [noise=true , address=185.167.204.206:4052 , piece_id=VKCT42KRTPICXNF4RW6QYHI4RWAA6BOUIW3QCSPYCMPGEM74MT5A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690240306 (308h58m39.574194507s) [noise=true , address=185.167.204.206:4053 , piece_id=YFYT72XEB6PUH6PWFR7TBK4VJ5HD5UD4JU7CFYATOS3I5ZDQ3Y3Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.690316488 (308h58m39.574270682s) [noise=true , address=81.171.14.70:4046 , piece_id=EUTW2KIMG5VOGW7H4S3L6H2PLI34VEHCHOPMFRYFJTN22YUN524A, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.693701257 (308h58m39.577655463s) [noise=true , address=81.171.14.70:4025 , piece_id=AFVBUHAOB5MSGAHIIPP56PZQY4BSJDW5HNX3ZJKVIVIWSROLGRKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694078262 (308h58m39.578032451s) [noise=true , address=185.167.204.206:4048 , piece_id=CY7IP6UOLC2JELTKPECGA4JBQQ46BOE7NJHO4UAE2ANXL76DQPZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.694724461 (308h58m39.578678668s) [noise=true , address=81.171.14.70:4028 , piece_id=DQ2EJ6VMXQ5XVA3ZFD6AJSQX3KMGB2QUEHO764MXXJBOOHTTYH5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.704600930 (308h58m39.588555152s) [noise=true , address=81.171.14.70:4037 , piece_id=EJWYC3VVCQFZETY5YHNNXBQ2TPSN4I4UFO2XZDEEX7O6KONZFIZQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.710932936 (308h58m39.594887145s) [noise=true , address=81.171.14.70:4032 , piece_id=WSJFT3FISNQGKK3E4AFWWRD5UZCBHHKNUZ7ZE2SJ3CBCRZQYLYJQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.711668209 (308h58m39.59562242s) [noise=true , address=185.167.204.206:4058 , piece_id=7QNIBY33NYFREF4QEH6TJTX3ZWXDQZFD4Y7HWI22YFYDUU7MBUZA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:01.712605145 (308h58m39.596559365s) [noise=true , address=81.171.14.70:4042 , piece_id=H5KKR4UQWBND2PKHIYTT773L52TPR7UCDAPDWFI4F3MJ2VYNSRBA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.115218136 (308h58m39.999172341s) [noise=true , address=81.171.14.70:4026 , piece_id=AWDI4NV22Q4WNEHZA32BNLMJO3D6HPKAOC47TKDCUNHUVUY6H6AQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.127052520 (308h58m40.011006731s) [noise=true , address=89.149.201.147:4018 , piece_id=FHFON543DXL7JK3ZZZP5CQOHS7XYIMJIRJFQBMPAH7UFXW2POJ5Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.182696653 (308h58m40.06665086s) [noise=true , address=89.149.201.147:4010 , piece_id=AWPOCB2NSIWBM6MPEMQREWJ63GBQ73BHFDWXROOVPIEKBIPYHYMQ, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.183445448 (308h58m40.067399652s) [noise=true , address=89.149.201.147:4015 , piece_id=QU4ZEE4HJXLBCSQCVRFOVQDE7HCKSWGSQ5C6BI52PZF3HCOGIVKA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:54:02.240186501 (308h58m40.124140708s) [noise=true , address=81.171.14.70:4047 , piece_id=T2MLPCSZCGKA3LLYA26EOP6O5RIP2BKSZUKSABTOTRL47OM5LBTA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: <nil> Jan 28 12:55:01.429550527 (308h59m39.313504728s) [noise=true , address=185.167.204.205:4010 , piece_id=437IUHCUNGZXUFKDJAY5HZAGIOBUPQVUDW6RMHKH6DCV5ZMED47Q, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:52786->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429653541 (308h59m39.313607736s) [noise=true , address=185.167.204.205:4015 , piece_id=DUOAHOKDDCXV3TVZAYQIGSXFI67VQP7VHBB3AYKHL6TMNTSZTDLA, seg_pos={0 0}, upload=271774]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: read tcp 139.59.144.22:39018->185.167.204.205:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:55:01.429732753 (308h59m39.31368695s) [seg_pos={0 0}, upload=271774]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 28 12:55:01.446332735 (308h59m39.330286941s) [upload=271774]: Done uploading segments... Jan 28 12:55:01.446381616 (308h59m39.330335822s) [upload=271774]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 593.134932ms core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)