Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.354033908s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:27:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.354061247s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X....X.............] duration:
2.40130941s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:27:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.401340252s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.396647715s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:27:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.396675492s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X....X............] duration:
2.251950753s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:26:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.252039388s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.288306955s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:26:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.288339445s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X....X...........] duration:
2.370744196s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:25:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.370778396s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X....X..........] duration:
2.432528595s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:24:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.432555262s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.180134869s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:24:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.180161524s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X....X.........] duration:
2.464700744s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:24:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.464731586s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X....X........] duration:
2.366744454s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:23:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.366774449s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.235770355s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:23:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.235796386s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X....X.......] duration:
2.330622741s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:23:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.330652939s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.447525513s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:22:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.447555779s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X....X......] duration:
2.266246978s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:22:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.266316207s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X....X.....] duration:
2.31151636s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:22:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.311547262s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.371840794s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:22:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.371893443s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X....X....] duration:
2.47986936s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:21:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.479901289s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.382132895s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:21:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.382163225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X....X...] duration:
2.396003512s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:21:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.396030466s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.388117283s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:21:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.38815168s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X....X..] duration:
2.585818119s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:20:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.585910749s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.51708596s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:19:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.517105788s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.113629654s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:19:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.113654208s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X....X.] duration:
18.220669309s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:19:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 18.22068629s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X....X] duration:
30.111004866s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:19:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 30.111021767s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.477799479s trace:
https://jaeger.dev.storj.io/trace/1722c860e160296f
FAIL (2026-02-06 14:17:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
(526h18m24.93436477s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050739539 (526h18m24.934693744s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050798422 (526h18m24.934752625s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051093267 (526h18m24.935047466s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051276578 (526h18m24.935230778s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051356932 (526h18m24.935311134s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051629168 (526h18m24.935583367s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051698081 (526h18m24.93565228s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051902608 (526h18m24.935856811s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052106014 (526h18m24.936060223s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052286456 (526h18m24.936240665s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052525643 (526h18m24.936479845s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052730446 (526h18m24.936684651s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052933344 (526h18m24.936887548s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.661738114 (526h18m25.545692311s) [upload=463155]: Next returned nil segment
Feb 6 14:13:47.661760472 (526h18m25.54571469s) [upload=463155]: Waiting for error group managing segments...
Feb 6 14:13:47.799557885 (526h18m25.683512094s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.803441530 (526h18m25.687395739s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.804974539 (526h18m25.688928747s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.805502610 (526h18m25.689456819s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.814869464 (526h18m25.698823673s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.819499607 (526h18m25.703453819s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:14:16.621489166 (526h18m54.505443375s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:14:16.621562041 (526h18m54.505516262s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection
Feb 6 14:14:16.621736680 (526h18m54.505690901s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection
Feb 6 14:14:16.621888061 (526h18m54.505842271s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.621980116 (526h18m54.505934327s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:34220->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622184597 (526h18m54.506138809s) [noise=true , address=77.90.31.14:4662 , piece_id=GZULSOUNZK442TBQDEJFDY7KLHKJNZ6CUCKQHN4CFV2H4HHFNGQA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:47492->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622243442 (526h18m54.50619765s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection
Feb 6 14:14:16.622377958 (526h18m54.506332166s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection
Feb 6 14:14:16.622561385 (526h18m54.506515594s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: read tcp 139.59.144.22:59688->79.127.219.38:4822: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622727525 (526h18m54.506681735s) [noise=true , address=77.90.31.11:4553 , piece_id=AHPEXH3BDZ4PBOXPH5UZTD7FOJLRTLSLYJBSDBK64P273KRZ5EZQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:32912->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622771147 (526h18m54.506725347s) [seg_pos={0 0}, upload=463155]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Feb 6 14:14:16.739968817 (526h18m54.623923025s) [upload=463155]: Done uploading segments...
Feb 6 14:14:16.740015841 (526h18m54.623970074s) [upload=463155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 2.477844937s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.31281964s trace:
https://jaeger.dev.storj.io/trace/1722c860e160296f
FAIL (2026-02-06 14:16:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
(526h18m24.93436477s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050739539 (526h18m24.934693744s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050798422 (526h18m24.934752625s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051093267 (526h18m24.935047466s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051276578 (526h18m24.935230778s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051356932 (526h18m24.935311134s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051629168 (526h18m24.935583367s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051698081 (526h18m24.93565228s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051902608 (526h18m24.935856811s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052106014 (526h18m24.936060223s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052286456 (526h18m24.936240665s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052525643 (526h18m24.936479845s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052730446 (526h18m24.936684651s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052933344 (526h18m24.936887548s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.661738114 (526h18m25.545692311s) [upload=463155]: Next returned nil segment
Feb 6 14:13:47.661760472 (526h18m25.54571469s) [upload=463155]: Waiting for error group managing segments...
Feb 6 14:13:47.799557885 (526h18m25.683512094s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.803441530 (526h18m25.687395739s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.804974539 (526h18m25.688928747s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.805502610 (526h18m25.689456819s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.814869464 (526h18m25.698823673s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.819499607 (526h18m25.703453819s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:14:16.621489166 (526h18m54.505443375s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:14:16.621562041 (526h18m54.505516262s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection
Feb 6 14:14:16.621736680 (526h18m54.505690901s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection
Feb 6 14:14:16.621888061 (526h18m54.505842271s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.621980116 (526h18m54.505934327s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:34220->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622184597 (526h18m54.506138809s) [noise=true , address=77.90.31.14:4662 , piece_id=GZULSOUNZK442TBQDEJFDY7KLHKJNZ6CUCKQHN4CFV2H4HHFNGQA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:47492->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622243442 (526h18m54.50619765s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection
Feb 6 14:14:16.622377958 (526h18m54.506332166s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection
Feb 6 14:14:16.622561385 (526h18m54.506515594s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: read tcp 139.59.144.22:59688->79.127.219.38:4822: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622727525 (526h18m54.506681735s) [noise=true , address=77.90.31.11:4553 , piece_id=AHPEXH3BDZ4PBOXPH5UZTD7FOJLRTLSLYJBSDBK64P273KRZ5EZQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:32912->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622771147 (526h18m54.506725347s) [seg_pos={0 0}, upload=463155]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Feb 6 14:14:16.739968817 (526h18m54.623923025s) [upload=463155]: Done uploading segments...
Feb 6 14:14:16.740015841 (526h18m54.623970074s) [upload=463155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 2.312851293s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.657595033s trace:
https://jaeger.dev.storj.io/trace/1722c860e160296f
FAIL (2026-02-06 14:15:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
(526h18m24.93436477s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050739539 (526h18m24.934693744s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050798422 (526h18m24.934752625s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051093267 (526h18m24.935047466s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051276578 (526h18m24.935230778s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051356932 (526h18m24.935311134s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051629168 (526h18m24.935583367s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051698081 (526h18m24.93565228s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051902608 (526h18m24.935856811s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052106014 (526h18m24.936060223s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052286456 (526h18m24.936240665s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052525643 (526h18m24.936479845s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052730446 (526h18m24.936684651s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052933344 (526h18m24.936887548s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.661738114 (526h18m25.545692311s) [upload=463155]: Next returned nil segment
Feb 6 14:13:47.661760472 (526h18m25.54571469s) [upload=463155]: Waiting for error group managing segments...
Feb 6 14:13:47.799557885 (526h18m25.683512094s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.803441530 (526h18m25.687395739s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.804974539 (526h18m25.688928747s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.805502610 (526h18m25.689456819s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.814869464 (526h18m25.698823673s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.819499607 (526h18m25.703453819s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:14:16.621489166 (526h18m54.505443375s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:14:16.621562041 (526h18m54.505516262s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection
Feb 6 14:14:16.621736680 (526h18m54.505690901s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection
Feb 6 14:14:16.621888061 (526h18m54.505842271s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.621980116 (526h18m54.505934327s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:34220->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622184597 (526h18m54.506138809s) [noise=true , address=77.90.31.14:4662 , piece_id=GZULSOUNZK442TBQDEJFDY7KLHKJNZ6CUCKQHN4CFV2H4HHFNGQA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:47492->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622243442 (526h18m54.50619765s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection
Feb 6 14:14:16.622377958 (526h18m54.506332166s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection
Feb 6 14:14:16.622561385 (526h18m54.506515594s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: read tcp 139.59.144.22:59688->79.127.219.38:4822: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622727525 (526h18m54.506681735s) [noise=true , address=77.90.31.11:4553 , piece_id=AHPEXH3BDZ4PBOXPH5UZTD7FOJLRTLSLYJBSDBK64P273KRZ5EZQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:32912->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622771147 (526h18m54.506725347s) [seg_pos={0 0}, upload=463155]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Feb 6 14:14:16.739968817 (526h18m54.623923025s) [upload=463155]: Done uploading segments...
Feb 6 14:14:16.740015841 (526h18m54.623970074s) [upload=463155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 2.657639392s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.143194456s trace:
https://jaeger.dev.storj.io/trace/1722c860e160296f
FAIL (2026-02-06 14:14:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
(526h18m24.93436477s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050739539 (526h18m24.934693744s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050798422 (526h18m24.934752625s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051093267 (526h18m24.935047466s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051276578 (526h18m24.935230778s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051356932 (526h18m24.935311134s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051629168 (526h18m24.935583367s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051698081 (526h18m24.93565228s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051902608 (526h18m24.935856811s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052106014 (526h18m24.936060223s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052286456 (526h18m24.936240665s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052525643 (526h18m24.936479845s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052730446 (526h18m24.936684651s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052933344 (526h18m24.936887548s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.661738114 (526h18m25.545692311s) [upload=463155]: Next returned nil segment
Feb 6 14:13:47.661760472 (526h18m25.54571469s) [upload=463155]: Waiting for error group managing segments...
Feb 6 14:13:47.799557885 (526h18m25.683512094s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.803441530 (526h18m25.687395739s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.804974539 (526h18m25.688928747s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.805502610 (526h18m25.689456819s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.814869464 (526h18m25.698823673s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.819499607 (526h18m25.703453819s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:14:16.621489166 (526h18m54.505443375s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:14:16.621562041 (526h18m54.505516262s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection
Feb 6 14:14:16.621736680 (526h18m54.505690901s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection
Feb 6 14:14:16.621888061 (526h18m54.505842271s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.621980116 (526h18m54.505934327s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:34220->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622184597 (526h18m54.506138809s) [noise=true , address=77.90.31.14:4662 , piece_id=GZULSOUNZK442TBQDEJFDY7KLHKJNZ6CUCKQHN4CFV2H4HHFNGQA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:47492->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622243442 (526h18m54.50619765s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection
Feb 6 14:14:16.622377958 (526h18m54.506332166s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection
Feb 6 14:14:16.622561385 (526h18m54.506515594s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: read tcp 139.59.144.22:59688->79.127.219.38:4822: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622727525 (526h18m54.506681735s) [noise=true , address=77.90.31.11:4553 , piece_id=AHPEXH3BDZ4PBOXPH5UZTD7FOJLRTLSLYJBSDBK64P273KRZ5EZQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:32912->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622771147 (526h18m54.506725347s) [seg_pos={0 0}, upload=463155]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Feb 6 14:14:16.739968817 (526h18m54.623923025s) [upload=463155]: Done uploading segments...
Feb 6 14:14:16.740015841 (526h18m54.623970074s) [upload=463155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 6.143222412s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.120605456s trace:
https://jaeger.dev.storj.io/trace/1722c860e160296f
FAIL (2026-02-06 14:14:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
(526h18m24.93436477s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050739539 (526h18m24.934693744s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.050798422 (526h18m24.934752625s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051093267 (526h18m24.935047466s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051276578 (526h18m24.935230778s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051356932 (526h18m24.935311134s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051629168 (526h18m24.935583367s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051698081 (526h18m24.93565228s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.051902608 (526h18m24.935856811s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052106014 (526h18m24.936060223s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052286456 (526h18m24.936240665s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052525643 (526h18m24.936479845s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052730446 (526h18m24.936684651s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.052933344 (526h18m24.936887548s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Uploading piece...
Feb 6 14:13:47.661738114 (526h18m25.545692311s) [upload=463155]: Next returned nil segment
Feb 6 14:13:47.661760472 (526h18m25.54571469s) [upload=463155]: Waiting for error group managing segments...
Feb 6 14:13:47.799557885 (526h18m25.683512094s) [noise=true , address=45.91.116.14:4224 , piece_id=SLO2HLGPSU3G7AV4SNMUYDKAZFF4BQXSDQ6Q4IL475E5627VGKJA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.803441530 (526h18m25.687395739s) [noise=true , address=45.91.116.8:4070 , piece_id=K3ILSQE7VAKSR3YI7UW2JRPCU2HLWWB4STQF7AH7G2M2NQ4U4EAQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.804974539 (526h18m25.688928747s) [noise=true , address=45.91.116.14:4192 , piece_id=DMAXQ3LYDGBMZLN7ZYX4L7W27AGA7P3EK42MKT2OGCQ3GWD4GNNQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.805502610 (526h18m25.689456819s) [noise=true , address=45.91.116.13:4154 , piece_id=45HHGMKWKRLKFWNBP4VBQE3XQYKF4UP5E74KYQD67CKP3FGAEWYQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.814869464 (526h18m25.698823673s) [noise=true , address=45.91.116.9:4295 , piece_id=OK6SVIZVCFDUHJY4NUYIOUTCIL6V7IWSFAIOYQNACNJOMXFFZGSA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:13:47.819499607 (526h18m25.703453819s) [noise=true , address=45.91.116.11:4120 , piece_id=XR75BVAPQTTUFPTFOAJ7XADUPV5W4PIN3VIQHY2XVIS76I3YXC6A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: <nil>
Feb 6 14:14:16.621489166 (526h18m54.505443375s) [noise=true , address=77.90.31.11:4555 , piece_id=6RCOJFYKB5T73BHYYJ7JN5KYAIDMYGYTUK3ORRQSLBSCMEXT7U7A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:14:16.621562041 (526h18m54.505516262s) [noise=true , address=79.127.219.38:4818 , piece_id=73N3FWDDXRUWXXQO4FW4XPSGFN7WLOA4Q4NXFYZU5KCAXLXJQ26Q, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41444->79.127.219.38:4818: use of closed network connection
Feb 6 14:14:16.621736680 (526h18m54.505690901s) [noise=true , address=77.90.31.18:4808 , piece_id=KPOKFJ7DS7UNNNNWASPIYYC2NOEY4B7ZZEIRQ6XA6227BSG6SYGQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51154->77.90.31.18:4808: use of closed network connection
Feb 6 14:14:16.621888061 (526h18m54.505842271s) [noise=true , address=77.90.31.13:4626 , piece_id=WBM5WBLZEIFCEGVJO3TQA2PW46PMMLIYOTGWQKD2IGZV7UM6SW3A, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.621980116 (526h18m54.505934327s) [noise=true , address=77.90.31.21:4877 , piece_id=MLUU2Y35GARGYHBG2KI3SAJNY6Y257UTLOSVBAHEI3T5HOZJJSFA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:34220->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622184597 (526h18m54.506138809s) [noise=true , address=77.90.31.14:4662 , piece_id=GZULSOUNZK442TBQDEJFDY7KLHKJNZ6CUCKQHN4CFV2H4HHFNGQA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:47492->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622243442 (526h18m54.50619765s) [noise=true , address=77.90.31.19:4841 , piece_id=FS64RZY5NDPIOLTSZ5PJVZQPTTR22HCXIEDOFAY6LJZCZCRMPOVA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51766->77.90.31.19:4841: use of closed network connection
Feb 6 14:14:16.622377958 (526h18m54.506332166s) [noise=true , address=79.127.219.46:4890 , piece_id=VEM5A2LTGRC3KMRFZ63XWHSSNV3ZN4HHRNWQJWH46TX3MMROE6IA, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47408->79.127.219.46:4890: use of closed network connection
Feb 6 14:14:16.622561385 (526h18m54.506515594s) [noise=true , address=79.127.219.38:4822 , piece_id=54Z6UYSHBRDA5A6IKRWW7O3DZ7TA3SHUTDTSWMBJAAWKLPSXH3XQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: read tcp 139.59.144.22:59688->79.127.219.38:4822: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622727525 (526h18m54.506681735s) [noise=true , address=77.90.31.11:4553 , piece_id=AHPEXH3BDZ4PBOXPH5UZTD7FOJLRTLSLYJBSDBK64P273KRZ5EZQ, seg_pos={0 0}, upload=463155]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:32912->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:14:16.622771147 (526h18m54.506725347s) [seg_pos={0 0}, upload=463155]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Feb 6 14:14:16.739968817 (526h18m54.623923025s) [upload=463155]: Done uploading segments...
Feb 6 14:14:16.740015841 (526h18m54.623970074s) [upload=463155]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 30.120632898s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
1.639037714s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:51:18 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.639066329s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
1.620460085s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:50:31 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.620485321s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
1.668090962s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:49:55 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.668122932s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
1.564184297s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:49:07 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.564210712s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
1.581157908s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:48:12 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.581179235s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.633806227s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:47:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.633833358s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.591668616s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:46:46 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.591702137s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
1.689644331s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:45:40 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.689695855s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
2.126230138s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:44:32 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.126257015s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
1.632947976s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:43:31 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.632974205s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.652656189s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:42:50 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.65268616s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
1.691323986s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:41:54 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.691350099s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.588076232s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:40:44 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.588124336s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.608014846s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:40:08 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.608042636s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
1.705308114s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:39:20 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.705340008s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.851850532s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:38:06 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.85187845s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
1.610535838s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:37:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.610571305s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
1.722865591s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:37:05 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.722921592s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.659901608s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:36:32 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.659932721s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.85170539s trace:
https://jaeger.dev.storj.io/trace/22767c2b52266d91
FAIL (2026-02-06 04:36:15 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.85178854s
core
uplink
us-select-1
us1-placement-20
|