Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 3.43204847s FAIL (2025-09-11 22:20:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.432145402s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X....XX...........................................] duration: 3.047020866s FAIL (2025-09-11 22:19:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 3.047048316s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.....X....XXXXXX..X.........................................] duration: 2.924206166s FAIL (2025-09-11 22:19:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.924280748s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.943889881s FAIL (2025-09-11 22:19:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.943924631s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.998257715s FAIL (2025-09-11 22:19:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.998288351s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X..........X....XX..........................................] duration: 2.701435228s FAIL (2025-09-11 22:19:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.701532543s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [......X....XXXXXX..X........................................] duration: 2.67013632s FAIL (2025-09-11 22:18:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.670180661s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.......X....XXXXXX..X.......................................] duration: 2.774142574s FAIL (2025-09-11 22:18:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.774201203s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.69510095s FAIL (2025-09-11 22:18:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.695150242s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X..........X....XX.........................................] duration: 2.833881522s FAIL (2025-09-11 22:18:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.83391772s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X..........X....XX........................................] duration: 2.647273561s FAIL (2025-09-11 22:17:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.647305639s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.676634341s FAIL (2025-09-11 22:17:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.676658381s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X..........X....XX.......................................] duration: 2.740214139s FAIL (2025-09-11 22:17:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.740259789s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [........X....XXXXXX..X......................................] duration: 2.925459156s FAIL (2025-09-11 22:17:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.92557563s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.380329063s FAIL (2025-09-11 22:17:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.380355842s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........X....XXXXXX..X.....................................] duration: 2.765334409s FAIL (2025-09-11 22:16:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.765373723s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X..........X....XX......................................] duration: 2.942594079s FAIL (2025-09-11 22:16:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.942628971s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [X.........X....XXXXXX..X....................................] duration: 2.862182102s FAIL (2025-09-11 22:16:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.862217484s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 3.445874476s FAIL (2025-09-11 22:16:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.445900513s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X..........X....XX.....................................] duration: 2.791140121s FAIL (2025-09-11 22:15:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.791194787s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.X.........X....XXXXXX..X...................................] duration: 2.894604452s FAIL (2025-09-11 22:15:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.894722218s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 3.065373044s FAIL (2025-09-11 22:14:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.065404853s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X..........X....XX....................................] duration: 2.71402378s FAIL (2025-09-11 22:14:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.71419228s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..X.........X....XXXXXX..X..................................] duration: 2.755580479s FAIL (2025-09-11 22:14:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.755610066s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.658509443s FAIL (2025-09-11 22:14:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.658538111s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.712006007s FAIL (2025-09-11 22:13:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.712056778s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X..........X....XX...................................] duration: 2.605328171s FAIL (2025-09-11 22:13:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.605398217s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.938150076s FAIL (2025-09-11 22:13:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.938335284s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...X.........X....XXXXXX..X.................................] duration: 2.805124545s FAIL (2025-09-11 22:13:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.80516592s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X..........X....XX..................................] duration: 2.500709872s FAIL (2025-09-11 22:12:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.500749313s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 3.626314793s FAIL (2025-09-11 22:12:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.626369154s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [....X.........X....XXXXXX..X................................] duration: 2.835193518s FAIL (2025-09-11 22:12:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.835222349s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X..........X....XX.................................] duration: 2.623226517s FAIL (2025-09-11 22:12:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.623258799s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.811731333s FAIL (2025-09-11 22:12:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.811759167s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.98725754s FAIL (2025-09-11 22:11:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.987292748s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.....X.........X....XXXXXX..X...............................] duration: 3.007308195s FAIL (2025-09-11 22:11:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.008350136s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.849393216s FAIL (2025-09-11 22:11:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.849424123s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X..........X....XX................................] duration: 2.694702525s FAIL (2025-09-11 22:11:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.694740771s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X..........X....XX...............................] duration: 2.626988487s FAIL (2025-09-11 22:10:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.627030154s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 3.445751128s FAIL (2025-09-11 22:10:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.445823693s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [......X.........X....XXXXXX..X..............................] duration: 2.536321709s FAIL (2025-09-11 22:10:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.536370796s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.......X.........X....XXXXXX..X.............................] duration: 2.736426394s FAIL (2025-09-11 22:10:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.736460037s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X..........X....XX..............................] duration: 2.674559937s FAIL (2025-09-11 22:09:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.67459061s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.835413412s FAIL (2025-09-11 22:09:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.835471318s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [........X.........X....XXXXXX..X............................] duration: 2.936215784s FAIL (2025-09-11 22:09:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.936243989s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.........X.........X....XXXXXX..X...........................] duration: 2.690423511s FAIL (2025-09-11 22:09:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.69045081s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X..........X....XX.............................] duration: 2.735074516s FAIL (2025-09-11 22:08:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 1) ======LOGS====== 1:45:15.890231684 (319h37m36.382664118s) [upload=281052]: Next returned nil segment Sep 11 21:45:15.890253932 (319h37m36.382686366s) [upload=281052]: Waiting for error group managing segments... Sep 11 21:45:17.623571308 (319h37m38.116003736s) [noise=true , address=145.79.227.4:4185 , piece_id=26VX4O467OVWY5QMCF3F7TLYD4X5AUFQ7JTZ6K6SNCCH7EFGF4WA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: <nil> Sep 11 21:45:39.344341667 (319h37m59.836774116s) [noise=true , address=77.90.31.13:4627 , piece_id=5ES6JXFIKVRBIKJUNBDPCTSMBYRESWEM4QUWXGQIL33IMIIOFIDA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56334->77.90.31.13:4627: use of closed network connection Sep 11 21:45:39.344486826 (319h37m59.83691927s) [noise=true , address=77.90.31.12:4590 , piece_id=F2XS6LKWGUGSXOULA7EVGPPPW6LTF7JWGWPX62XGF7R7LUO2IJYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45280->77.90.31.12:4590: use of closed network connection Sep 11 21:45:39.344502281 (319h37m59.836934734s) [noise=true , address=77.90.31.19:4841 , piece_id=EIBY5ALRX5O5CWEFCAXIVKWNZKC5GZU4SSPHE7DEUSJ35FK3EBGQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40516->77.90.31.19:4841: use of closed network connection Sep 11 21:45:39.344561777 (319h37m59.836994222s) [noise=true , address=45.91.116.9:4261 , piece_id=XUZ5GZX2RWQA7MG66A5YMTEGRYIGRKONLFM57KUBDSGOQCPSZ4BA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60708->45.91.116.9:4261: use of closed network connection Sep 11 21:45:39.344625139 (319h37m59.837057582s) [noise=true , address=45.91.116.13:4153 , piece_id=EYNG2ZYT2Z6OQCCD2CUVCH72PBDHMXJHNDE7STRDRWVL4ZPMOISQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38088->45.91.116.13:4153: use of closed network connection Sep 11 21:45:39.344678085 (319h37m59.837110532s) [noise=true , address=77.90.31.21:4877 , piece_id=VH5O4AO34QC3NMCXG3XZUCGDHEZ76MTNPKM3QXCNU3UOG2XD2XEQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40778->77.90.31.21:4877: use of closed network connection Sep 11 21:45:39.344699153 (319h37m59.837131589s) [noise=true , address=77.90.31.10:4520 , piece_id=RDVR3MTWK7EUYOQSY4ORNJW6CWGPDP555ZSCOJKLIR5VGGVVTYHA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47622->77.90.31.10:4520: use of closed network connection Sep 11 21:45:39.344734747 (319h37m59.837167193s) [noise=true , address=45.91.116.14:4191 , piece_id=4MIU3Q52EJP7CTNFOSRMSO7XZQYOTA6OJVVNYFMOJS5AV5Z2E3FA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50614->45.91.116.14:4191: use of closed network connection Sep 11 21:45:39.344770948 (319h37m59.837203383s) [noise=true , address=45.91.116.5:4298 , piece_id=OKGCCMFQECJZPULIFG3MW6H4MANORRP32BOSV5NARPCOQPVWCVFA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42064->45.91.116.5:4298: use of closed network connection Sep 11 21:45:39.344794817 (319h37m59.83722726s) [noise=true , address=77.90.31.13:4628 , piece_id=6OSXPDEY5MXH2PXV6J7EKJUETOJVNZZVUO64ZLJRZYIXRMAF6ZVA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52954->77.90.31.13:4628: use of closed network connection Sep 11 21:45:39.344825894 (319h37m59.837258337s) [noise=true , address=45.91.116.10:4083 , piece_id=LYA4MDJW327UM4BHZQRQNVXZ3OWYJYO5YILFTA4TOV6QBGZ3XEQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35828->45.91.116.10:4083: use of closed network connection Sep 11 21:45:39.344841415 (319h37m59.837273848s) [noise=true , address=45.91.116.8:4048 , piece_id=KNXAQXSQCFUMXVBAM3AZETFRFUCNMMD4R5VFYRFW2M3Z5XIMACQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->45.91.116.8:4048: use of closed network connection Sep 11 21:45:39.344853494 (319h37m59.837285943s) [noise=true , address=45.91.116.6:4973 , piece_id=AQ4FNPHKJR4G6BH2MIFF5AZRW2EPX2JZGNGMTU3ZGT3ATX52JKYA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50392->45.91.116.6:4973: use of closed network connection Sep 11 21:45:39.344881468 (319h37m59.837313903s) [noise=true , address=77.90.31.16:4734 , piece_id=FB7FMOOOTH5SJHWSL5AXQ4VTHZRZJEUQC2CFSICWGOQ7PTONPEKQ, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43296->77.90.31.16:4734: use of closed network connection Sep 11 21:45:39.344889620 (319h37m59.837322056s) [noise=true , address=77.90.31.15:4697 , piece_id=4A2VFQU7KKJZ2JMDWWYZQV4NO5ZYJJTORAW55JW7KOLUZOEQBZQA, seg_pos={0 0}, upload=281052]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46968->77.90.31.15:4697: use of closed network connection Sep 11 21:45:39.344919264 (319h37m59.837351705s) [seg_pos={0 0}, upload=281052]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil> Sep 11 21:45:39.448241035 (319h37m59.940673472s) [upload=281052]: Done uploading segments... Sep 11 21:45:39.448288520 (319h37m59.940720957s) [upload=281052]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1) Duration: 2.735108903s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 3.084647456s FAIL (2025-09-11 22:08:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.084676353s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..........X.........X....XXXXXX..X..........................] duration: 3.308990067s FAIL (2025-09-11 22:08:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.309015854s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.88287981s FAIL (2025-09-11 22:08:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.882906757s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)