Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
405.940254ms
FAIL (2025-10-07 05:12:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 405.976191ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
428.336851ms
FAIL (2025-10-07 05:12:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 428.374131ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
388.22251ms
FAIL (2025-10-07 05:11:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 388.2765ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
447.978042ms
FAIL (2025-10-07 05:10:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 448.01014ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
466.00023ms
FAIL (2025-10-07 05:10:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 466.033032ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
417.969488ms
FAIL (2025-10-07 05:09:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 418.053437ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
469.383428ms
FAIL (2025-10-07 05:08:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 469.418415ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
471.252879ms
FAIL (2025-10-07 05:07:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 471.284842ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
548.706656ms
FAIL (2025-10-07 05:06:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 548.742143ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
530.365289ms
FAIL (2025-10-07 05:06:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 530.404738ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
429.920579ms
FAIL (2025-10-07 05:05:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 430.031111ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
462.858717ms
FAIL (2025-10-07 05:05:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 462.900449ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
590.317994ms
FAIL (2025-10-07 05:04:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 590.361004ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
522.062215ms
FAIL (2025-10-07 05:02:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 522.095334ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
900.741996ms
FAIL (2025-10-07 05:01:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 900.777585ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
872.743397ms
FAIL (2025-10-07 05:01:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 872.780243ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
616.789495ms
FAIL (2025-10-07 05:00:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 616.819825ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
430.466171ms
FAIL (2025-10-07 04:59:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 430.502621ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
890.189665ms
FAIL (2025-10-07 04:58:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 890.235657ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
556.806597ms
FAIL (2025-10-07 04:57:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 556.843692ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
487.108972ms
FAIL (2025-10-07 04:57:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 487.178681ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
377.282796ms
FAIL (2025-10-07 04:56:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 377.402158ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
533.986671ms
FAIL (2025-10-07 04:55:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 534.091793ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
423.388096ms
FAIL (2025-10-07 04:54:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 423.419637ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
433.684125ms
FAIL (2025-10-07 04:54:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 433.717694ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
459.836083ms
FAIL (2025-10-07 04:53:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 459.874675ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
458.692815ms
FAIL (2025-10-07 04:52:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 458.775775ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
419.918307ms
FAIL (2025-10-07 04:52:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 419.946401ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
441.639769ms
FAIL (2025-10-07 04:52:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 441.704769ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
452.483651ms
FAIL (2025-10-07 04:51:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 452.530882ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
406.445892ms
FAIL (2025-10-07 04:51:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 406.480364ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
480.413378ms
FAIL (2025-10-07 04:50:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 480.46058ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
446.886426ms
FAIL (2025-10-07 04:50:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 446.922865ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
15.766728807s
FAIL (2025-10-07 04:49:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 15.766774344s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.020571993s
FAIL (2025-10-07 04:49:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 10)
======LOGS======
288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.525978676 (327h18m12.329443254s) [noise=true , address=89.149.201.147:4020 , piece_id=6X366FMMBQY7UMWRZWHWK24ODNSXNRK33EBT357XTN2QGNZ2XARQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.529349437 (327h18m12.332814029s) [noise=true , address=89.149.201.147:4007 , piece_id=GISIRIBAQZ4POYEFCQIFGEORZEB3DNANYK2FRE47HJD6KCHCWFIQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.531248958 (327h18m12.334713557s) [noise=true , address=81.171.14.70:4034 , piece_id=WXUMWYCPOYMDQRAC3GCH66ORLQEW4QMXCT6Z3IZGN75QPOHRJ44A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.544080578 (327h18m12.347545162s) [noise=true , address=89.149.201.147:4005 , piece_id=UN4KYWSCWFRCG6I44PP3HG3WQYJHHRYA73RE7XKYNWFMQZ4BPNHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.556041962 (327h18m12.359506556s) [noise=true , address=81.171.14.70:4030 , piece_id=W7VSTDTWQZKAKTQ4XXJEZEWWULVUS3VWLK7GXAIC5DC5JXWGDB6A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:48:24.612240410 (327h18m12.41570499s) [noise=true , address=81.171.14.70:4025 , piece_id=EFCX2CLEJGLGAS5HY66X7YJUNZEMYDXRDTRG4TZQ25IF4J6QZPUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: <nil>
Oct 7 04:49:24.310483073 (327h19m12.113947666s) [noise=true , address=185.167.204.205:4011 , piece_id=2VDETVRCNNWJC7CRL6WRZJZMZFIHI76LWIJAFRIBLMJUECKZ3SKA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310527972 (327h19m12.113992556s) [noise=true , address=81.171.14.70:4028 , piece_id=HEFFOFVIYWTKT4RBKADCIREX354RWAO5USR2VTTIVVIERFV3AKDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: rpc: dial tcp 81.171.14.70:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310706256 (327h19m12.114170848s) [noise=true , address=89.149.201.147:4016 , piece_id=NR6WTUSOAMYODXHX2V62FGTKTBFQTK5JENXKR5J4HTBGIGKTTGMA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310894451 (327h19m12.114359047s) [noise=true , address=185.167.204.206:4058 , piece_id=WFFNR3LXSVF3HVHKHU4O6LBYVDDFGBLGCG4ZQZHOKJEECNNJIKXQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.310931505 (327h19m12.114396086s) [noise=true , address=185.167.204.206:4068 , piece_id=HBYTPAXUFS7ZM7OQRAKPDNITIVQOLSOH4RN362XBXOEZB4RFEGEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311073712 (327h19m12.114538311s) [noise=true , address=185.167.204.205:4018 , piece_id=KJA3E24NTU4J3FTWCJ2U4B5UICGUWDLS5VSTMB45SFGQNIGO3BSA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: rpc: dial tcp 185.167.204.205:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311100756 (327h19m12.114565337s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZBB2XTBENBEQMD34O7LIISQHOCEOEZADNPXZOGD5XYJY4OLRHHA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:59630->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311261060 (327h19m12.114725661s) [noise=true , address=81.171.14.70:4048 , piece_id=QUGF3RADQM3FHXACWUHOYCUAYYBI33B4XMXZ62JL5O7L2KIVUOUA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: rpc: dial tcp 81.171.14.70:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311315674 (327h19m12.114780271s) [noise=true , address=89.149.201.147:4012 , piece_id=MSSU4KAU2AR3YULH6W7JOXM6IG3NIAFU6UGX3FCFEKFLN72BSVYQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311573657 (327h19m12.115038254s) [noise=true , address=185.167.204.205:4025 , piece_id=XB2P432VMB2BJHSWNQCB4B33ZIDAR43QQD74ABRFF43MYRJZDAEA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311641089 (327h19m12.11510567s) [noise=true , address=185.167.204.206:4060 , piece_id=FMVOGLOA67LN7G5JVY6NZZCNPR7PMZHBURUQGNKIRIUK7ZV4EGQA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311759265 (327h19m12.115223862s) [noise=true , address=185.167.204.205:4028 , piece_id=26AU5QE6RTN7FTB7XXOB2CGR5VJ7SIRURQUN2DB5G64EIIU6YV5Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311824674 (327h19m12.115289254s) [noise=true , address=185.167.204.206:4062 , piece_id=WWXKTOXCQ3X5QURTWE6DJ7VC25IOK4U7LKPZ72FRCQ7UUMQMD45A, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 139.59.144.22:48898->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.311937619 (327h19m12.115402215s) [noise=true , address=185.167.204.206:4055 , piece_id=3QNJ4SSDSMAZVSU4KKKB2XO4I24RAVORE3G375K4Z5ARSLIODWCQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312048594 (327h19m12.115513172s) [noise=true , address=185.167.204.205:4022 , piece_id=UMO7EQ4TYZTTBYTOTCSD7PIWPBKDE6UQNRRWJ62UJXMAQEK7VE2Q, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312109260 (327h19m12.115573856s) [noise=true , address=89.149.201.147:4014 , piece_id=DFU2C7O7SSA3SUZ5RFKRN5XU6BEDCJVNNOAUPRDLFXOO5WVTWPDA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 139.59.144.22:45014->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312154108 (327h19m12.115618686s) [noise=true , address=185.167.204.206:4051 , piece_id=G3ZZYDQ3RA37A56XPHCN5SZP5OX32HOYS5QRK6R3IPVETEGZJYKQ, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 139.59.144.22:55302->185.167.204.206:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312192236 (327h19m12.115656819s) [noise=true , address=185.167.204.205:4021 , piece_id=Y3IZRKFF75CAXPCZS56QGCO65NTLFJBIQB2ZT6NND5J33FWGEENA, seg_pos={0 0}, upload=288035]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 04:49:24.312223288 (327h19m12.115687882s) [seg_pos={0 0}, upload=288035]: Done waiting for segment. successful: 10 optimal: 26 errs: <nil>
Oct 7 04:49:24.327964660 (327h19m12.131429241s) [upload=288035]: Done uploading segments...
Oct 7 04:49:24.327992813 (327h19m12.131457395s) [upload=288035]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 10)
Duration: 1m0.020600845s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.144188822s
FAIL (2025-10-07 02:23:03 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.144229428s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
988.797968ms
FAIL (2025-10-07 02:22:19 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 988.832314ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.328682815s
FAIL (2025-10-07 02:21:38 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.328713293s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.123963944s
FAIL (2025-10-07 02:21:08 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.124000963s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.310882288s
FAIL (2025-10-07 02:19:58 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.310909501s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.208783907s
FAIL (2025-10-07 02:18:58 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.208811072s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
964.115716ms
FAIL (2025-10-07 02:18:31 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 964.139892ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
961.755692ms
FAIL (2025-10-07 02:17:41 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 961.792864ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.085234895s
FAIL (2025-10-07 02:16:26 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.085264194s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.211112665s
FAIL (2025-10-07 02:15:43 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.211139935s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.035094168s
FAIL (2025-10-07 02:15:25 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.035191576s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
997.1639ms
FAIL (2025-10-07 02:14:51 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 997.194475ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.024411185s
FAIL (2025-10-07 02:14:25 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.02445401s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.300612422s
FAIL (2025-10-07 02:13:53 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.300648926s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.158468178s
FAIL (2025-10-07 02:12:52 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.158498664s
core
uplink
us-select-1
|