Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration:
14.453635172s remote:
"tcp:185.244.226.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml X-Request-Id=iz4onvpcNvh Date=Fri, 12 Dec 2025 10:16:37 GMT Content-Length=454 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18807059673ACAD2 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/551ac686e2356ae1
FAIL (2025-12-12 10:16:37 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.226.97:60080->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18807059673ACAD2</RequestId><HostId></HostId></Error>"
Duration: 14.453665791s
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................................................X.....XXX] duration:
7.31559557s trace:
https://jaeger.dev.storj.io/trace/300d6d93d5b34c50
FAIL (2025-12-12 10:16:27 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:53660->34.2.157.232:7777: write: connection refused
Duration: 7.315621375s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................................................XXX.] duration:
2.033005624s trace:
https://jaeger.dev.storj.io/trace/190d560683484d28
FAIL (2025-12-12 10:16:08 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:41004->34.2.157.232:7777: write: connection refused
Duration: 2.033070114s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [.....................................................X...XX.] duration:
612.409331ms remote:
"tcp:185.244.226.4:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=MDAq2DmLghH Date=Fri, 12 Dec 2025 10:15:18 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/1545bf8ef35eae6f
FAIL (2025-12-12 10:16:06 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 612.442486ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX] duration:
15.540792825s remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=423 Content-Type=application/xml Vary=Origin X-Request-Id=cb8nC5GuuaB X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1880705102442A91 Date=Fri, 12 Dec 2025 10:16:02 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2a8ca05e1cfa52fb
FAIL (2025-12-12 10:16:02 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880705102442A91</RequestId><HostId></HostId></Error>"
Duration: 15.540822347s
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
7.519199038s trace:
https://jaeger.dev.storj.io/trace/190d560683484d28
FAIL (2025-12-12 10:15:33 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:41004->34.2.157.232:7777: write: connection refused
Duration: 7.51922517s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
27.655183278s remote:
"tcp:185.244.226.3:443" response headers:
X-Request-Id=PUYakcM7QNn Accept-Ranges=bytes Content-Length=431 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=188070474F204B4F X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:15:33 GMT Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/40dec7a8242b7500
FAIL (2025-12-12 10:15:33 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>188070474F204B4F</RequestId><HostId></HostId></Error>"
Duration: 27.655201172s
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [......................................................X...XX] duration:
24.599658507s remote:
"tcp:185.244.226.4:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=MDAq2DmLghH Date=Fri, 12 Dec 2025 10:15:18 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/1545bf8ef35eae6f
FAIL (2025-12-12 10:15:18 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 24.599674169s
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................................................X.....XX] duration:
7.325748546s trace:
https://jaeger.dev.storj.io/trace/1a895f66253a0f05
FAIL (2025-12-12 10:15:13 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused
Duration: 7.325773059s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
39.068644809s remote:
"tcp:185.244.226.3:443" response headers:
Accept-Ranges=bytes Content-Length=431 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1880703E2E56DD2B X-Request-Id=Sqr7pnMA4vd Date=Fri, 12 Dec 2025 10:15:05 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5b860fd75bbf4171
FAIL (2025-12-12 10:15:05 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880703E2E56DD2B</RequestId><HostId></HostId></Error>"
Duration: 39.068673776s
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
2 out of 60 is failed (threshold=6) [.......................................................X...X] duration:
21.503915397s remote:
"tcp:185.244.226.4:443" response headers:
Date=Fri, 12 Dec 2025 10:14:53 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=P4BKzFM448V target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6167d1917577e540
FAIL (2025-12-12 10:14:53 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 21.503944505s
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.....X] duration:
7.317501959s trace:
https://jaeger.dev.storj.io/trace/28565856542ab9e
FAIL (2025-12-12 10:14:36 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:50618->34.2.157.232:7777: write: connection refused
Duration: 7.317529848s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
7.322267184s trace:
https://jaeger.dev.storj.io/trace/3530a7955ccddb76
FAIL (2025-12-12 10:14:35 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused
Duration: 7.322295001s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.04807679s trace:
https://jaeger.dev.storj.io/trace/7ef6580e0a48340b
FAIL (2025-12-12 10:14:00 UTC)
orbiter warning: operation: Commit uplink: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:57256->34.2.157.232:7777: write: connection refused
Duration: 6.048106071s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
1.728412113s remote:
"tcp:185.244.226.4:443" response headers:
Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=41kybQrs2WY Date=Fri, 12 Dec 2025 10:12:04 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/60491e6965e1c3b9
FAIL (2025-12-12 10:13:56 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 1.728477534s
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
14.485281321s remote:
"tcp:185.244.226.3:443" response headers:
X-Amz-Request-Id=188070321FCD580E X-Request-Id=KuKYBJ8b1Tc Date=Fri, 12 Dec 2025 10:13:48 GMT Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6161367ee97669a1
FAIL (2025-12-12 10:13:48 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.226.97:42590->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>188070321FCD580E</RequestId><HostId></HostId></Error>"
Duration: 14.485325534s
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
7.32475318s trace:
https://jaeger.dev.storj.io/trace/6742f839032f0d70
FAIL (2025-12-12 10:13:45 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused
Duration: 7.324775775s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
14.960929869s remote:
"tcp:185.244.226.4:443" response headers:
Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=41kybQrs2WY Date=Fri, 12 Dec 2025 10:12:04 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/60491e6965e1c3b9
FAIL (2025-12-12 10:13:08 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 14.960961003s
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.842427367s trace:
https://jaeger.dev.storj.io/trace/7ef6580e0a48340b
FAIL (2025-12-12 10:12:44 UTC)
orbiter warning: operation: Commit uplink: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:57256->34.2.157.232:7777: write: connection refused
Duration: 3.8425168s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
8.155450725s remote:
"tcp:185.244.226.4:443" response headers:
Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=41kybQrs2WY Date=Fri, 12 Dec 2025 10:12:04 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/60491e6965e1c3b9
FAIL (2025-12-12 10:12:41 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 8.155483338s
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
14.435942203s remote:
"tcp:185.244.226.4:443" response headers:
Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=41kybQrs2WY Date=Fri, 12 Dec 2025 10:12:04 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/60491e6965e1c3b9
FAIL (2025-12-12 10:12:04 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 14.435969586s
edge
linksharing
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.002822286s trace:
https://jaeger.dev.storj.io/trace/7ef6580e0a48340b
FAIL (2025-12-12 10:11:37 UTC)
orbiter warning: operation: Commit uplink: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:57256->34.2.157.232:7777: write: connection refused
Duration: 6.002872049s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
3.185436913s trace:
https://jaeger.dev.storj.io/trace/7ef6580e0a48340b
FAIL (2025-12-12 10:11:00 UTC)
orbiter warning: operation: Commit uplink: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:57256->34.2.157.232:7777: write: connection refused
Duration: 3.185503447s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.636481939s trace:
https://jaeger.dev.storj.io/trace/7ef6580e0a48340b
FAIL (2025-12-12 10:10:17 UTC)
orbiter warning: operation: Commit uplink: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:57256->34.2.157.232:7777: write: connection refused
Duration: 3.636526563s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.189836171s trace:
https://jaeger.dev.storj.io/trace/7ef6580e0a48340b
FAIL (2025-12-12 10:09:57 UTC)
orbiter warning: operation: Commit uplink: metaclient: rpc: tcp connector failed: rpc: write tcp 139.59.144.22:57256->34.2.157.232:7777: write: connection refused
Duration: 2.189859182s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
448.343123ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:25:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 448.369772ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
462.605501ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:24:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 462.623757ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
517.276329ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:23:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 517.318775ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
852.239368ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:22:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 852.3339ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
405.784783ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:21:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 405.819364ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
442.378747ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:20:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 442.408077ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
422.728136ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:20:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 422.759208ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
558.68939ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:19:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 558.724692ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
466.979237ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:17:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 467.011526ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
911.396071ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:17:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 911.443711ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
470.47626ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:17:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 470.570057ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
469.212147ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:16:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 469.24178ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
935.397668ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:16:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 935.431389ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
568.950349ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:15:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 568.979898ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
504.381651ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:15:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 504.415111ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
474.255085ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:14:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 474.282728ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
540.343095ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:14:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 540.378125ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
424.169566ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:13:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 424.199324ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
458.749321ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:13:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 458.790378ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
875.077721ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:13:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 875.103227ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
519.331584ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:12:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 519.361974ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
856.798568ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:11:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 856.823689ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
441.129745ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:10:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 441.156644ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
872.205967ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:09:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 872.23356ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
924.432411ms trace:
https://jaeger.dev.storj.io/trace/3ae8fe29db53691a
FAIL (2025-12-12 06:09:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
...
Dec 12 05:42:13.988722600 (158h13m53.969075242s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.988900016 (158h13m53.969252655s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989319185 (158h13m53.969671812s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989354732 (158h13m53.96970738s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.989769101 (158h13m53.970121747s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990182495 (158h13m53.970535138s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990517842 (158h13m53.970870481s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.990925931 (158h13m53.971278574s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991361448 (158h13m53.971714094s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:13.991741821 (158h13m53.97209446s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Uploading piece...
Dec 12 05:42:14.107928268 (158h13m54.088280906s) [upload=139104]: Next returned nil segment
Dec 12 05:42:14.107943655 (158h13m54.088296293s) [upload=139104]: Waiting for error group managing segments...
Dec 12 05:42:14.143878671 (158h13m54.124231316s) [noise=true , address=185.167.204.205:4020 , piece_id=WIN3DPC2LVCP6YGFMD4V5YO4YBSN5JDWSYU3Q546JANVX4GFAJKQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144449264 (158h13m54.124801955s) [noise=true , address=185.167.204.205:4006 , piece_id=SKA2GRWMDLQDJGKCSFZFPSKM325BXLTGWRVZTJ2DA65TS46ZSN4Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144554567 (158h13m54.124907218s) [noise=true , address=185.167.204.206:4050 , piece_id=2N6KXLGCECFJF3FXTF6EMF3PPSYXCQ5WGAAMWA5R2GGKS466TBAA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.144873044 (158h13m54.125225681s) [noise=true , address=89.149.201.147:4012 , piece_id=5PDPOGTZLRCIJ7M35CXTW6GOJ5M34WEPQ4GNCTJLEP6YLUKEDKRA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.145143762 (158h13m54.125496424s) [noise=true , address=185.167.204.206:4064 , piece_id=QGRBJEH3EZFT4MDOBJD6PSJIW55FZ5QVF2AKQSUTLVY5WYLFL4NA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.146470846 (158h13m54.126823482s) [noise=true , address=185.167.204.205:4010 , piece_id=HWVGZM3J243P3Y3FIDDETN4TTTDHS6UQ2SE7Z24NQEMROBLHVY3A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.148851245 (158h13m54.129203882s) [noise=true , address=81.171.14.70:4025 , piece_id=XBYFK3KOMQULVSPUJQ6L56GV7CZH5CICIE2NHRM6XQBNP6TCLQJQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.149349031 (158h13m54.129701675s) [noise=true , address=185.167.204.205:4024 , piece_id=CDZNYSDBGLMGC3JEPMQ7HZ2MUTNIRD4GUN5ZMVPCOS5IDP6HFHHQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.151916683 (158h13m54.132269308s) [noise=true , address=81.171.14.70:4039 , piece_id=B47VOA2QB3L7YBQWD6Q7U7NYUBFMVGAKGFDLI56MRJETX6XWYBMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154007026 (158h13m54.134359672s) [noise=true , address=185.167.204.206:4045 , piece_id=IOEJXAOFJAGBMR3NSIMGBQE4PYAFRMXBKZROEMMDDJJFHGF4WYDQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154777922 (158h13m54.135130562s) [noise=true , address=185.167.204.206:4070 , piece_id=KZX6XCCUOP5EWYBXHV5RXMJ74OH43HZJFB7RVULOYLW62GOR5J3Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.154986928 (158h13m54.135339571s) [noise=true , address=81.171.14.70:4035 , piece_id=DYXDL36BLX2V3YNPTOGKRV7ZUM43C5TQDBHH4G6ZIOJWVFICMSGQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.159433048 (158h13m54.139785688s) [noise=true , address=185.167.204.206:4056 , piece_id=IOQM2C6RFO67BUC7PQS6MFJZVIIWW52P4LKY6VKLD3FHLHI2AT2Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.160619492 (158h13m54.140972136s) [noise=true , address=185.167.204.206:4065 , piece_id=AIW55NPTYYQPKIFIQ3XRT7WXVWFSM3INSJAPCCF5YZ3BD7XYDRNQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.161709189 (158h13m54.142061832s) [noise=true , address=89.149.201.147:4023 , piece_id=VYO2E5YOISSO7MAK645IBHTW7JLMAC7XCYT4OV5G6UTY6NFFMI5Q, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.169382157 (158h13m54.149734802s) [noise=true , address=81.171.14.70:4031 , piece_id=KCV7YOR7US5Y4V2RZ22X5TWS7ESQBTZGP2U257IVA4EQDPXM7BMQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.172527936 (158h13m54.152880572s) [noise=true , address=185.167.204.205:4031 , piece_id=V6GVVBFEHZKPJ35GTZ7BFWXL6EYKR7A7P2T2PUOFMUT7ZBOSAWVA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173399585 (158h13m54.153752229s) [noise=true , address=81.171.14.70:4033 , piece_id=ZODORDJUIALS5MZZPHNM3QUHZH3UXFZF5XCPYQIT7O5532U6SBPA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.173940394 (158h13m54.154293034s) [noise=true , address=185.167.204.206:4040 , piece_id=I46G3LHTX3U3HNHMNPKAKPRZXE5BMVVOOWYO2HTADA54EI4MYUTA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.178939300 (158h13m54.159291936s) [noise=true , address=89.149.201.147:4007 , piece_id=QRFQK3H7WEVKI3ZT3PUIF2GFOWJU7QWSZXBSYKXYT7626GSY2QGA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.196248192 (158h13m54.176600829s) [noise=true , address=81.171.14.70:4041 , piece_id=5OPWB3RGOBHDZILAQG3RDEDY24FPVSKX23VH5YMWXPWDMY4M77QA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.199883053 (158h13m54.180235689s) [noise=true , address=89.149.201.147:4009 , piece_id=Q4HBUZCAS3IHU65OTHUEKKFPYF44QZUNQ5KNBNHSKT7DUH36TXEQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.216837324 (158h13m54.19718997s) [noise=true , address=89.149.201.147:4006 , piece_id=CFBR2ILS7FDJJ7NCBLXKGQX6UW7TMPUCBKQOO43EUDFO7D5SMMBQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.613780906 (158h13m54.594133545s) [noise=true , address=89.149.201.147:4011 , piece_id=UTQK45TQKH5PAOFJJJOWBIZHXCAVI6VOELDHOHXY3R5OBWBQJ4JA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.636868779 (158h13m54.617221415s) [noise=true , address=81.171.14.70:4026 , piece_id=IRGODMI3Q3OQ6ZQQ3DZ3KAWE5ZAMYBSOYAPKEYUWCTHYTTKMI5PA, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648278802 (158h13m54.628631449s) [noise=true , address=89.149.201.147:4014 , piece_id=NOQFD3AKLIG3R5BUR3C427VZG6SZJYXHFZNVALSFL6ODECYZEV7A, seg_pos={0 0}, upload=139104]: Done uploading piece. err: <nil>
Dec 12 05:42:14.648359280 (158h13m54.628711926s) [seg_pos={0 0}, upload=139104]: Segment reached optimal threshold of 26 pieces.
Dec 12 05:42:14.648741844 (158h13m54.62909449s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648756114 (158h13m54.629108762s) [noise=true , address=89.149.201.147:4021 , piece_id=W7ARKA4E7ZDYTVWP2CQMZPRMNILHUXVVKM4HRAPKPTBJ5EGQPQPQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648819443 (158h13m54.629172089s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec 12 05:42:14.648849631 (158h13m54.629202268s) [noise=true , address=81.171.14.70:4046 , piece_id=ZFLYAZBH357NVPEPHDXQAYPJ2KH7DYHC7N6MAU3AB2VBS26RU5DQ, seg_pos={0 0}, upload=139104]: Long tail cancellation due to optimal threshold
Dec 12 05:42:14.648883908 (158h13m54.629236539s) [seg_pos={0 0}, upload=139104]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 12 05:42:14.649166253 (158h13m54.629518898s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 12 05:42:14.649175436 (158h13m54.629528084s) [upload=139104]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 12 05:44:04.940569758 (158h15m44.920922405s) [upload=139104]: Done uploading segments...
Dec 12 05:44:04.940644866 (158h15m44.92099751s) [upload=139104]: Upload finished. err: metaclient: context deadline exceeded
Duration: 924.464347ms
core
uplink
eu-select-1
eu1-placement-15
|