Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.442776816s
FAIL (2025-09-19 05:53:03 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.442798842s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.567352747s
FAIL (2025-09-19 05:52:29 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.567454187s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.35682273s
FAIL (2025-09-19 05:51:49 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.356857692s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.629347246s
FAIL (2025-09-19 05:50:55 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.629379617s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.935499021s
FAIL (2025-09-19 05:49:54 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.935534314s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.195592936s
FAIL (2025-09-19 05:49:21 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.195625749s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.214462298s
FAIL (2025-09-19 05:48:16 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.214498564s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.395935477s
FAIL (2025-09-19 05:47:23 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.395972144s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.405123409s
FAIL (2025-09-19 05:46:47 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.405161986s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.693650352s
FAIL (2025-09-19 05:45:40 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.693685785s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.562702936s
FAIL (2025-09-19 05:45:20 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.562764671s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.494762484s
FAIL (2025-09-19 05:44:39 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.494792862s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.374465304s
FAIL (2025-09-19 05:44:16 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.374499924s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.582141688s
FAIL (2025-09-19 05:44:00 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.582176039s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.471907676s
FAIL (2025-09-19 05:43:02 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.471947097s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.294397582s
FAIL (2025-09-19 05:42:01 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.294433052s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.617665172s
FAIL (2025-09-19 05:41:13 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.617694773s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.371558165s
FAIL (2025-09-19 05:40:24 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.371601885s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.49724339s
FAIL (2025-09-19 05:39:24 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.497271189s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000451534s
FAIL (2025-09-19 05:38:52 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 30.00046881s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.429368917s
FAIL (2025-09-19 04:34:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.429400572s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.585878258s
FAIL (2025-09-19 04:34:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.585933969s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.58760328s
FAIL (2025-09-19 04:33:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.587638218s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.713831177s
FAIL (2025-09-19 04:32:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.713867323s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.464367964s
FAIL (2025-09-19 04:32:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.464409758s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
3.504252529s
FAIL (2025-09-19 04:32:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.504279737s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.724271521s
FAIL (2025-09-19 04:31:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.724368492s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.530130293s
FAIL (2025-09-19 04:31:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.53016249s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
2.669930531s
FAIL (2025-09-19 04:31:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.670021094s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
3.151023832s
FAIL (2025-09-19 04:30:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.151119615s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
3.313500875s
FAIL (2025-09-19 04:30:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.313530769s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.626835797s
FAIL (2025-09-19 04:30:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.626864305s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
2.785339821s
FAIL (2025-09-19 04:30:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.785444101s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.664587671s
FAIL (2025-09-19 04:29:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.664627939s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.554211833s
FAIL (2025-09-19 04:28:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.554244791s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
2.835185951s
FAIL (2025-09-19 04:28:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.835255175s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
2.999425914s
FAIL (2025-09-19 04:27:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.999745228s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.431820586s
FAIL (2025-09-19 04:27:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.431854087s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
2.921951373s
FAIL (2025-09-19 04:27:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.921975533s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
2.761523507s
FAIL (2025-09-19 04:26:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.761544664s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.399783189s
FAIL (2025-09-19 04:26:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.39981404s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.672521317s
FAIL (2025-09-19 04:25:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.672557401s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................] duration:
3.280682682s
FAIL (2025-09-19 04:25:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.280772258s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.616090467s
FAIL (2025-09-19 04:24:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.616151664s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................] duration:
2.921652892s
FAIL (2025-09-19 04:24:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.921749344s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.644914301s
FAIL (2025-09-19 04:23:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.645035966s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................] duration:
2.659783663s
FAIL (2025-09-19 04:23:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.65981701s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.644202691s
FAIL (2025-09-19 04:23:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.644234131s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................] duration:
2.546154076s
FAIL (2025-09-19 04:23:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.546204006s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.533410541s
FAIL (2025-09-19 04:22:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0)
======LOGS======
UQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece...
Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded
Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil>
Duration: 2.533494584s
core
uplink
us-select-1
us1-placement-20
|