Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.950549112s trace:
https://jaeger.dev.storj.io/trace/42206651daeeda15
FAIL (2025-11-14 03:02:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.950579777s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.879183403s trace:
https://jaeger.dev.storj.io/trace/42206651daeeda15
FAIL (2025-11-14 03:01:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.879214089s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.033084338s trace:
https://jaeger.dev.storj.io/trace/42206651daeeda15
FAIL (2025-11-14 03:00:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.033105894s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
3.019542848s trace:
https://jaeger.dev.storj.io/trace/42206651daeeda15
FAIL (2025-11-14 03:00:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.019599392s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.886532387s trace:
https://jaeger.dev.storj.io/trace/42206651daeeda15
FAIL (2025-11-14 02:59:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.88655127s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000932692s trace:
https://jaeger.dev.storj.io/trace/42206651daeeda15
FAIL (2025-11-14 02:59:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001079462s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
478.04661ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:22:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 478.079209ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
500.038973ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:21:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 500.086091ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
461.360331ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:20:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 461.399942ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
508.421771ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:19:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 508.451056ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
993.912716ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:19:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 993.940695ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
517.547601ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:18:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 517.583318ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.00304588s trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:17:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1.003063669s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
487.465537ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:16:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 487.496382ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
809.658587ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:16:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 809.745321ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
444.42752ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:15:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 444.474016ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
553.266216ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:15:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 553.296187ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
931.888766ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:13:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 931.923035ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
468.86401ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:13:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 468.916622ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
660.243959ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:12:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 660.277211ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
493.676327ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:11:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 493.704532ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
417.814211ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:10:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 417.844651ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
986.744861ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:10:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 986.777034ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
677.637287ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:09:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 677.771674ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
995.004742ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:08:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 995.035002ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
956.433692ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:08:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 956.509402ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
954.21664ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:07:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 954.269388ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
961.400418ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:06:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 961.443251ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.015209493s trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:05:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1.015240815s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
921.095654ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:04:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 921.174956ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
944.386647ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:03:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 944.42993ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
971.649727ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:03:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 971.680979ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.018112668s trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:02:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1.018140378s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.024385968s trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:01:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1.024419832s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
515.309834ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:00:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 515.346327ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
967.629952ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-14 00:00:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 967.667296ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
947.344805ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:59:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 947.377437ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
881.506972ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:58:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 881.574148ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
954.791659ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:57:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 954.855591ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
971.284183ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:56:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 971.313209ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
899.34512ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:56:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 899.376928ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
951.15566ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:54:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 951.182737ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
903.764411ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:54:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 903.792128ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
915.378583ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:53:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 915.408973ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
946.242927ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:52:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 946.271701ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
451.303417ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:51:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 451.330234ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
453.23275ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:51:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 453.258442ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
505.19892ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:50:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 505.228733ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
925.959004ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:50:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 925.983768ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
528.885339ms trace:
https://jaeger.dev.storj.io/trace/2e8c315807960d64
FAIL (2025-11-13 23:49:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.926005299 (61h52m44.284663962s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.929123510 (61h52m44.28778218s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.932654398 (61h52m44.291313062s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.934736256 (61h52m44.293394921s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.937062874 (61h52m44.295721542s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.939102726 (61h52m44.297761394s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.943141504 (61h52m44.301800168s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.944751043 (61h52m44.303409708s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.949079107 (61h52m44.307737768s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.951182916 (61h52m44.309841582s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.954367741 (61h52m44.313026408s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.958446307 (61h52m44.317104973s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:58.960464661 (61h52m44.319123328s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Uploading piece...
Nov 13 23:36:59.088112365 (61h52m44.446771032s) [upload=54414]: Next returned nil segment
Nov 13 23:36:59.088133093 (61h52m44.446791756s) [upload=54414]: Waiting for error group managing segments...
Nov 13 23:36:59.101386268 (61h52m44.460044922s) [noise=true , address=89.149.201.147:4012 , piece_id=2Q7UWD4LP74ENJDE2AMZLQHEGTVLN26UC7JS6BLMEVLGCHROQPHA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.103153757 (61h52m44.46181241s) [noise=true , address=185.167.204.205:4004 , piece_id=L35RCWDDXQPSB6VUHAN3HQEMBTPL5S2BVXSVSNHX6YCCTT7ELJCQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.104323192 (61h52m44.462981845s) [noise=true , address=185.167.204.206:4064 , piece_id=3HI3RDXMYFWRKMCCKRJ4AAAS45P7POGPVHSSD6PCCY226S5K6YBQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.112790690 (61h52m44.471449354s) [noise=true , address=185.167.204.206:4040 , piece_id=LLECSEHFCQYJL4WAA53PWGINRCJIP5PV37UYB64WTCR7TA4A7H4A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113033673 (61h52m44.471692486s) [noise=true , address=185.167.204.205:4005 , piece_id=DASW7YFMX73MG2LA2ZES3GVOEJDECSBD7S7XUEOH73DPYVLRADRA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.113577262 (61h52m44.472235923s) [noise=true , address=185.167.204.206:4060 , piece_id=3XZSFKUH7BA4SPLQCIAZ5CMJ55QGFPMQCEK52G4MFKALLHY2RP5A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116165646 (61h52m44.474824304s) [noise=true , address=185.167.204.206:4053 , piece_id=SIT4PCND7VWFCQADKNPLOLXLAF6KXFH23QSWUL2GPEWZTV6E63MQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.116231837 (61h52m44.474890493s) [noise=true , address=185.167.204.206:4068 , piece_id=X6Y5VTZD7XCRTTQOUGEYVBO2R3BMQ7MDCYUSNRRXTH4PGJUAKCVA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121079946 (61h52m44.479738608s) [noise=true , address=81.171.14.70:4038 , piece_id=CFNDBTXZ2UOUMI7XEGT6QTVDDFNBAWIXHGDBDSVUWYOAASRV76WA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.121883987 (61h52m44.480542652s) [noise=true , address=185.167.204.205:4018 , piece_id=CLGB2MJSLPLCSQSTCVW4CHMZFBXOSJXJYRDBYGQT5S5QRDQPP3AA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.122288991 (61h52m44.480947653s) [noise=true , address=185.167.204.206:4044 , piece_id=X3LVBZKQQI47QZ7UBFWD7DR4B2NBM3QR4B5UXXLOGFHTZOWTKUQQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.124890155 (61h52m44.483548821s) [noise=true , address=185.167.204.205:4011 , piece_id=CWWZ2IBPEWE4B4AG6AZLRJ665AZ4AP4RPIUVUGVLUPW3XWM7UOLQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.125573181 (61h52m44.484231847s) [noise=true , address=81.171.14.70:4045 , piece_id=QJXJU7RPWMWDNO6XG44S5DKPXMBKHGEMV2KMFZ7LXWLXDQU6NYPA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.126515280 (61h52m44.48517394s) [noise=true , address=185.167.204.205:4022 , piece_id=36WFLXECQLTM2O2KEXQJESTNZZO3I7ZFKZR4JAWO3ZWMFABPKCFA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.136307840 (61h52m44.494966499s) [noise=true , address=185.167.204.206:4057 , piece_id=L24P43MF6T746JO7YOP2GVWPEFDPNHEVG6TR64E6CI4EKFBUNIWA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.139052572 (61h52m44.497711232s) [noise=true , address=185.167.204.205:4010 , piece_id=RS4LC6QKMQB26GYUW7FB24INJ6HZGUFKLQQYCF42MBRDCIIDNDRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.145832426 (61h52m44.50449108s) [noise=true , address=89.149.201.147:4002 , piece_id=AIYXN3K3TO7GLZEIVA6OSCCWQWQCMXMYJWB5KN3YORM5NYXYXTEA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.146470307 (61h52m44.50512896s) [noise=true , address=89.149.201.147:4013 , piece_id=EZUOANHZHQRH75RMMKVK6QMGO5KHIIKGAEGEINNMEVMZGR6SZ4LQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.151920186 (61h52m44.510578843s) [noise=true , address=185.167.204.206:4071 , piece_id=GPSF7NFNCO5D27JO2LYKXDPOE6HRPSZS5GRBRFLY5UW76NDSDC3Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.152796432 (61h52m44.511455089s) [noise=true , address=89.149.201.147:4006 , piece_id=DJ4DSRV2NK36BEZPVADBSOLZCJARCNOXIUJ3PVBTELBKKBWFVWMA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.161206909 (61h52m44.519865574s) [noise=true , address=81.171.14.70:4042 , piece_id=DTKX7SG4LJN3N4MAMJMK6752I7IMV36REXJ5RGUMFIU3IY3XBXUQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.166647888 (61h52m44.525306527s) [noise=true , address=89.149.201.147:4001 , piece_id=ACL5AYIGUJVHLZB6NIU5PJ6JHMAFCAQ74EQ2J3BQRK3FJFCUY4IQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.175287218 (61h52m44.533945872s) [noise=true , address=89.149.201.147:4022 , piece_id=R6NIAUL7EPEMRPX243MUBN3DMRN5ZQ6LEQMYCGF45GKSN5TWMTZA, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.611073099 (61h52m44.969731761s) [noise=true , address=81.171.14.70:4025 , piece_id=CORLEXIG7QQM7WB7Z4DDBEUKVAKTDSNI3EIBFA6Y7CEKR6U75QWQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:36:59.621849033 (61h52m44.980507698s) [noise=true , address=81.171.14.70:4030 , piece_id=UFH2EF7FJWX6W4QQ2WL6V25IGW4MHWL3KXAUKESALU6NGO3UCKRQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: <nil>
Nov 13 23:37:58.885971202 (61h53m44.244629862s) [noise=true , address=81.171.14.70:4031 , piece_id=CMMV3QAZ3ZZYDYVIAVREL2TX7JJCLI3ONFCEMDYSXNM7JPQAHYNQ, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.886459028 (61h53m44.245117693s) [noise=true , address=81.171.14.70:4036 , piece_id=FTGZBPMXEMTLO3W5GJTIUNQJRTTIMK2LTNOOIEOLYMKJFVB3DN3A, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: context deadline exceeded; context deadline exceeded
Nov 13 23:37:58.887007013 (61h53m44.245665676s) [noise=true , address=89.149.201.147:4010 , piece_id=52JNGWKNBTD7UQ7CMHLCC6TWBFYU5O3MBAFPRBVJLTB673KKSM5Q, seg_pos={0 0}, upload=54414]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:39686->89.149.201.147:4010: use of closed network connection; context deadline exceeded
Nov 13 23:37:58.887067324 (61h53m44.245725977s) [seg_pos={0 0}, upload=54414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Nov 13 23:37:58.909624792 (61h53m44.268283475s) [upload=54414]: Done uploading segments...
Nov 13 23:37:58.909671457 (61h53m44.268330122s) [upload=54414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 528.909848ms
core
uplink
eu-select-1
eu1-placement-15
|