Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 3.143508107s FAIL (2025-09-19 04:22:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.143708356s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.620218059s FAIL (2025-09-19 04:21:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.620250161s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.500391402s FAIL (2025-09-19 04:21:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.500430655s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 2.781963653s FAIL (2025-09-19 04:21:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.781988604s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 3.498161587s FAIL (2025-09-19 04:21:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.49821144s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.640510508s FAIL (2025-09-19 04:20:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.64055057s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 2.772967199s FAIL (2025-09-19 04:20:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.772991921s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 3.253823908s FAIL (2025-09-19 04:19:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.253934664s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.493710812s FAIL (2025-09-19 04:19:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.493743017s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 2.792815747s FAIL (2025-09-19 04:19:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.792842387s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.396005087s FAIL (2025-09-19 04:18:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.396043854s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.514646344s FAIL (2025-09-19 04:18:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.514675553s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 2.842920573s FAIL (2025-09-19 04:18:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.842943987s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.397145289s FAIL (2025-09-19 04:17:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.397179853s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 2.75894537s FAIL (2025-09-19 04:17:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.758973175s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.654476987s FAIL (2025-09-19 04:16:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.654533436s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 2.717701878s FAIL (2025-09-19 04:16:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.71772716s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.597733739s FAIL (2025-09-19 04:16:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.597762479s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.50683156s FAIL (2025-09-19 04:15:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.50685895s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 3.034136078s FAIL (2025-09-19 04:15:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.034173091s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.446932262s FAIL (2025-09-19 04:14:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.447028054s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.687802523s FAIL (2025-09-19 04:14:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.687833816s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 2.950431832s FAIL (2025-09-19 04:14:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.950460224s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 2.662053271s FAIL (2025-09-19 04:13:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.662081746s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.63121799s FAIL (2025-09-19 04:13:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.631252236s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.502454822s FAIL (2025-09-19 04:12:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.502484623s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................XX.................................] duration: 2.776545408s FAIL (2025-09-19 04:12:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.77665442s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.58372597s FAIL (2025-09-19 04:12:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.583791872s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 2.9144204s FAIL (2025-09-19 04:12:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.915069753s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 2.671848882s FAIL (2025-09-19 04:11:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.671880279s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.605587608s FAIL (2025-09-19 04:10:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.605666249s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 2.887551837s FAIL (2025-09-19 04:10:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.887574391s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.486538134s FAIL (2025-09-19 04:10:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.486766836s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 2.837532639s FAIL (2025-09-19 04:09:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.837558084s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.601108365s FAIL (2025-09-19 04:09:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.601143786s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 2.919735544s FAIL (2025-09-19 04:08:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.919757068s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.615718988s FAIL (2025-09-19 04:08:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.615761195s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 2.709957892s FAIL (2025-09-19 04:08:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.709984418s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.420995474s FAIL (2025-09-19 04:07:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.421028746s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.910784633s FAIL (2025-09-19 04:07:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.910810661s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.517228923s FAIL (2025-09-19 04:06:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.51725861s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 2.660732032s FAIL (2025-09-19 04:06:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.660756929s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.692201691s FAIL (2025-09-19 04:05:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.692230783s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 2.937895048s FAIL (2025-09-19 04:05:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.93796426s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 2.818765302s FAIL (2025-09-19 04:04:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.818889476s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.63704252s FAIL (2025-09-19 04:04:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.637088888s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 3.425713838s FAIL (2025-09-19 04:04:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.425744681s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.000888889s FAIL (2025-09-19 04:03:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 3.000917511s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.725191568s FAIL (2025-09-19 04:03:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171293002 (493h39m17.663725437s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.171975257 (493h39m17.664407693s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.174350984 (493h39m17.666783418s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.177310451 (493h39m17.669742886s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.179941279 (493h39m17.672373716s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.182528457 (493h39m17.674960885s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185193117 (493h39m17.67762555s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:46:57.185647080 (493h39m17.678079527s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Uploading piece... Sep 19 03:47:56.702693018 (493h40m17.19512547s) [upload=434191]: Next segment err: context deadline exceeded Sep 19 03:47:56.703255047 (493h40m17.195687499s) [noise=true , address=145.79.227.31:4828 , piece_id=TLVFYAPXMBXUD23PIDXIRLWPD7PO7ZJ6NDOOLYPLRQWP7KB46FQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k, address:145.79.227.31:4828): protocol: rpc: dial tcp 145.79.227.31:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703336893 (493h40m17.195769339s) [noise=true , address=145.79.227.30:4787 , piece_id=RDRBR4VD37QPX7JTXPM5DHTVJTM5KDCAGHT7FYAFFZO34T5OM5SA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: rpc: dial tcp 145.79.227.30:4787: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703393958 (493h40m17.195826401s) [noise=true , address=145.79.227.51:4434 , piece_id=SFMRY3FWZWSL2VMHHZFXQKJQYJX4RVB2BCHGJMJASFKRKGTBQYUQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX, address:145.79.227.51:4434): protocol: rpc: dial tcp 145.79.227.51:4434: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703879282 (493h40m17.196311717s) [noise=true , address=145.79.227.42:4156 , piece_id=2UCOZTMB2HRR5RY4MZIY2C7FKQUL7ISG5VOSHSOBZ2AVAUHDVDKA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12cFTycUosmf2ynRZmHYT1axN7VcS31wjqv74CxUpb5nThvmW5, address:145.79.227.42:4156): protocol: rpc: dial tcp 145.79.227.42:4156: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.703967838 (493h40m17.196400274s) [noise=true , address=145.79.227.26:4667 , piece_id=VQCMIFD72WA7JPFZLFZNSZWRREURKQZR3YUHFN3OO7OFZJW62YIQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12iLz6HjQQ1HK7nbPen8szRrZywZcbPTs58FmCPDnAyAEg4AvNk, address:145.79.227.26:4667): protocol: rpc: dial tcp 145.79.227.26:4667: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704050076 (493h40m17.19648251s) [noise=true , address=145.79.227.23:4577 , piece_id=2LQWJBV4RYUSGNA3CPRRV24VO6AXHKNMH5K7EZ7ZVQIQPNUDH3GA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP, address:145.79.227.23:4577): protocol: rpc: dial tcp 145.79.227.23:4577: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704137367 (493h40m17.196569806s) [noise=true , address=145.79.227.10:4412 , piece_id=LZXW5UUS7PHEIQQVIQNB5NNDMOYWXEEA2JTVYS22BJZB2VC4WIQQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX, address:145.79.227.10:4412): protocol: rpc: dial tcp 145.79.227.10:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704216674 (493h40m17.196649106s) [noise=true , address=145.79.227.52:4475 , piece_id=YBEMM43JRDDPXC5VKGKMAJ2EFA4Z3332OETKIMHGCYWISM5LFFSQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704290852 (493h40m17.196723286s) [noise=true , address=145.79.227.12:4786 , piece_id=OWU5JCNF4U7K3FKHRMD255DHHDGBCR2BNEK2USTPMMDFCMF4345Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:127aTG7tofhLA5799hT6gvZZSkT1vvWWFejx7DS4Zcz8mBHHsuE, address:145.79.227.12:4786): protocol: rpc: dial tcp 145.79.227.12:4786: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704363020 (493h40m17.196795452s) [noise=true , address=145.79.227.21:4482 , piece_id=4RXYM2XMYF4PZ5CMTXVVZCAYDXAEI7OJOGTHRFJ6FNYDKOPVYS4Q, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12B2s428CMVK7mdLV84VgWFcdRQaVQxcA7YuqqeqEM8FAefEGt7, address:145.79.227.21:4482): protocol: rpc: dial tcp 145.79.227.21:4482: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704430045 (493h40m17.196862477s) [noise=true , address=145.79.227.14:4870 , piece_id=AYUGQFLUKQMKQ5473IM4THLOYQ2DG6YJEAXJL2N7UWMLB6NSO67A, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:145.79.227.14:4870): protocol: rpc: dial tcp 145.79.227.14:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704444449 (493h40m17.196876902s) [noise=true , address=145.79.227.47:4283 , piece_id=EN7SUCIIULE2PGUOI2ON4G34225ZRQA3HFGUHDLYPDDQ7YE763CA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1p9jkPtQnmbCXBmw6HSHDWpGaKWqfg87m6hHXy6WDu2giAFnbQ, address:145.79.227.47:4283): protocol: rpc: dial tcp 145.79.227.47:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704468026 (493h40m17.196900462s) [noise=true , address=145.79.227.4:4217 , piece_id=5QVTT7FIAVOH42YCDTSL6VJNE7WSWXWZSGOCIICJKRHK4GBVX7FQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi, address:145.79.227.4:4217): protocol: rpc: dial tcp 145.79.227.4:4217: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704570213 (493h40m17.197002659s) [noise=true , address=145.79.227.28:4730 , piece_id=OTZOC46PESTUYYNUOZF7PJZSUQA3WJH6NNBMBHQLUJPSIRKUQDKQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: rpc: dial tcp 145.79.227.28:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704652142 (493h40m17.197084584s) [noise=true , address=145.79.227.17:4983 , piece_id=N2SUO43GSMQCNG34BXQMRVJO5IIXLTLZT3P6ZBGDDQEYP2REA2LQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12h6MND3rBadG4EjUP18S7izyj23cVBLaB5drFsuNGhcxwAYXSA, address:145.79.227.17:4983): protocol: rpc: dial tcp 145.79.227.17:4983: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704678787 (493h40m17.197111215s) [noise=true , address=145.79.227.29:4953 , piece_id=YLKSN7X4ZDJY4XXWSMCFGXO4SRRPKWQXQC3S6D2HJXB23T72ISPQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:12dhNW98YkWKWzXBnwmTCvzaw9CtvxRW8ELJnAjHnATFhpM1oKn, address:145.79.227.29:4953): protocol: rpc: dial tcp 145.79.227.29:4953: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704714590 (493h40m17.197147033s) [noise=true , address=145.79.227.24:4590 , piece_id=XYGLAI7GEPXL4USSJXEHXEK6B4XXKM2W7HXQ7YWYJDUAEX2J4CXQ, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:128t6B6PhCQznqwMTGJdkWuuCyqQ4bVHbPbZWWnYwb8Eyc1DjDw, address:145.79.227.24:4590): protocol: rpc: dial tcp 145.79.227.24:4590: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704768947 (493h40m17.19720139s) [noise=true , address=145.79.227.46:4613 , piece_id=QUJ6H6M4IOHBPKWHHAS7FRMJO43UGHXMI5EPHDZCNMDTNDFZ54IA, seg_pos={0 0}, upload=434191]: Done uploading piece. err: ecclient: upload failed (node:125xy2Y2QhNLeRQ9as4GccgVsyL1KUAtUChG4EJCDK8UYssFrR3, address:145.79.227.46:4613): protocol: rpc: dial tcp 145.79.227.46:4613: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:56.704799188 (493h40m17.197231637s) [seg_pos={0 0}, upload=434191]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2.725221695s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 2.90365322s FAIL (2025-09-19 04:03:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.903680479s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)