Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 408629 reports (Page 5138 of 8173)
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.669035053s
FAIL (2025-09-12 06:43:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.669061718s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.80614463s
FAIL (2025-09-12 06:42:02 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.806174892s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
3.075726821s
FAIL (2025-09-12 06:41:01 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.075796721s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
2.880719091s
FAIL (2025-09-12 06:40:25 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.880812075s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
2.688032043s
FAIL (2025-09-12 06:39:28 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.688132952s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.002003171s
FAIL (2025-09-12 06:39:11 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.00203148s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
2.859905836s
FAIL (2025-09-11 22:33:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.859934598s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
2.677387745s
FAIL (2025-09-11 22:32:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.678202687s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
2.617452732s
FAIL (2025-09-11 22:32:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.617592745s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
2.610778405s
FAIL (2025-09-11 22:31:50 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.610818829s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [X..X........................................................]
duration:
2.869703382s
FAIL (2025-09-11 22:31:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.869739442s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................]
duration:
2.8171379s
FAIL (2025-09-11 22:31:33 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.817181485s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [XX..X.......................................................]
duration:
2.89471227s
FAIL (2025-09-11 22:31:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.89480913s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................]
duration:
2.861407657s
FAIL (2025-09-11 22:30:32 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.861450651s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [XXX..X......................................................]
duration:
3.007860261s
FAIL (2025-09-11 22:30:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.007882922s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................]
duration:
2.859427438s
FAIL (2025-09-11 22:29:50 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.8595175s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [XXXX..X.....................................................]
duration:
2.671858265s
FAIL (2025-09-11 22:29:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.671889784s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................]
duration:
2.701563795s
FAIL (2025-09-11 22:29:31 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.70159312s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
6 out of 60 is failed (threshold=3) [XXXXX..X....................................................]
duration:
3.085730483s
FAIL (2025-09-11 22:29:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.085822364s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................]
duration:
2.948620358s
FAIL (2025-09-11 22:28:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.948647475s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
7 out of 60 is failed (threshold=3) [XXXXXX..X...................................................]
duration:
2.907520266s
FAIL (2025-09-11 22:28:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.907543183s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [X....XX.....................................................]
duration:
2.924912883s
FAIL (2025-09-11 22:27:59 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.924946454s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
2.843469723s
FAIL (2025-09-11 22:27:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.8434985s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.X....XX....................................................]
duration:
2.803920679s
FAIL (2025-09-11 22:27:25 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.803958293s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
7 out of 60 is failed (threshold=3) [.XXXXXX..X..................................................]
duration:
2.952019334s
FAIL (2025-09-11 22:27:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.952057521s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
2.867871483s
FAIL (2025-09-11 22:27:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.867955275s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
7 out of 60 is failed (threshold=3) [..XXXXXX..X.................................................]
duration:
3.008705507s
FAIL (2025-09-11 22:26:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.008734859s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [..X....XX...................................................]
duration:
2.642769822s
FAIL (2025-09-11 22:26:20 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.642798182s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
3.243248849s
FAIL (2025-09-11 22:26:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.243293643s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
7 out of 60 is failed (threshold=3) [...XXXXXX..X................................................]
duration:
2.889561687s
FAIL (2025-09-11 22:25:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.889585439s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [...X....XX..................................................]
duration:
2.79836862s
FAIL (2025-09-11 22:25:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.798466891s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
2.977899132s
FAIL (2025-09-11 22:25:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.977937718s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
7 out of 60 is failed (threshold=3) [....XXXXXX..X...............................................]
duration:
2.814255314s
FAIL (2025-09-11 22:25:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.814287917s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [....X....XX.................................................]
duration:
2.843858571s
FAIL (2025-09-11 22:24:53 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.84389115s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
3.00535126s
FAIL (2025-09-11 22:24:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.005379426s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [X....XXXXXX..X..............................................]
duration:
3.248011087s
FAIL (2025-09-11 22:24:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.248052361s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.....X....XX................................................]
duration:
2.841556549s
FAIL (2025-09-11 22:24:00 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.841635171s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [.X....XXXXXX..X.............................................]
duration:
2.821068044s
FAIL (2025-09-11 22:23:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.821091866s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
3.217065731s
FAIL (2025-09-11 22:23:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.21710231s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [......X....XX...............................................]
duration:
2.901078401s
FAIL (2025-09-11 22:23:06 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.901121541s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.......X....XX..............................................]
duration:
2.638370215s
FAIL (2025-09-11 22:22:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.638390565s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [..X....XXXXXX..X............................................]
duration:
2.978487664s
FAIL (2025-09-11 22:22:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.978518335s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
2.816080762s
FAIL (2025-09-11 22:22:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.816110921s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [........X....XX.............................................]
duration:
2.85305093s
FAIL (2025-09-11 22:22:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.853112134s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
3.588639037s
FAIL (2025-09-11 22:22:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.588705578s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
2.820489885s
FAIL (2025-09-11 22:21:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.820716466s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [...X....XXXXXX..X...........................................]
duration:
3.794327754s
FAIL (2025-09-11 22:21:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.794355431s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........X....XX............................................]
duration:
2.668646501s
FAIL (2025-09-11 22:21:06 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment
Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments...
Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185    , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil>
Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627     , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection
Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590     , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection
Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841     , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection
Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261     , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection
Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153    , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection
Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877     , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection
Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520     , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection
Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191    , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection
Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298     , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection
Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628     , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection
Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083    , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection
Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048     , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection
Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973     , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection
Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734     , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection
Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697     , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection
Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments...
Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 2.668693711s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
3.041706777s
FAIL (2025-09-11 22:20:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.041729286s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [....X....XXXXXX..X..........................................]
duration:
2.916618152s
FAIL (2025-09-11 22:20:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.916645619s edge gateway us-select-1