Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.634129263s FAIL (2025-07-02 04:42:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.634390834s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.287985163s FAIL (2025-07-02 04:42:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.288012044s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.659078743s FAIL (2025-07-02 04:42:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.659173216s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.364842542s FAIL (2025-07-02 04:41:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.364928077s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.687471452s FAIL (2025-07-02 04:41:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.687496588s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.311300785s FAIL (2025-07-02 04:40:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.311330857s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.848500528s FAIL (2025-07-02 04:40:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.848528968s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.346261457s FAIL (2025-07-02 04:39:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.346288807s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.344255374s FAIL (2025-07-02 04:39:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.344369765s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.80547288s FAIL (2025-07-02 04:39:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.805502305s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.491549415s FAIL (2025-07-02 04:38:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.49158027s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.461369989s FAIL (2025-07-02 04:38:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.461409217s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.686558289s FAIL (2025-07-02 04:37:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.686581941s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.291929725s FAIL (2025-07-02 04:37:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.291962247s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.639999642s FAIL (2025-07-02 04:36:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.640050683s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.355606466s FAIL (2025-07-02 04:36:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.355638168s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.825107956s FAIL (2025-07-02 04:35:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.825139537s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.411868505s FAIL (2025-07-02 04:35:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.411958343s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.794780598s FAIL (2025-07-02 04:34:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.794833627s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.38401016s FAIL (2025-07-02 04:34:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.384042953s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.2746956s FAIL (2025-07-02 04:33:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.274723113s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.83295946s FAIL (2025-07-02 04:33:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.832985623s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.516098415s FAIL (2025-07-02 04:33:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.516168501s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.31912193s FAIL (2025-07-02 04:32:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.319159245s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.546891649s FAIL (2025-07-02 04:32:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.546913737s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.28673515s FAIL (2025-07-02 04:32:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.286771262s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.715530517s FAIL (2025-07-02 04:32:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.715553597s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.659885263s FAIL (2025-07-02 04:31:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.659927429s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.526005319s FAIL (2025-07-02 04:31:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.526029606s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 3.592328118s FAIL (2025-07-02 04:31:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 3.592487037s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.348705501s FAIL (2025-07-02 04:30:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.348749388s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.887337917s FAIL (2025-07-02 04:30:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.887365556s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.258700773s FAIL (2025-07-02 04:29:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.258727619s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.666444242s FAIL (2025-07-02 04:29:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.666472128s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.722951976s FAIL (2025-07-02 04:29:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723002588s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.408330689s FAIL (2025-07-02 04:28:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.40836226s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.758119319s FAIL (2025-07-02 04:28:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.758173826s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.526165403s FAIL (2025-07-02 04:27:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.526200893s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.397144564s FAIL (2025-07-02 04:27:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.397176563s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.312098231s FAIL (2025-07-02 04:26:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.312121558s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.562848187s FAIL (2025-07-02 04:26:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.562872122s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.38422602s FAIL (2025-07-02 04:26:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.384260296s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.809679156s FAIL (2025-07-02 04:26:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.809708591s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.548097566s FAIL (2025-07-02 04:25:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.548129209s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.715008554s FAIL (2025-07-02 04:25:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.715035984s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.358410915s FAIL (2025-07-02 04:25:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.358442316s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.367360811s FAIL (2025-07-02 04:24:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.367395006s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.710515706s FAIL (2025-07-02 04:24:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.710545025s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.310471585s FAIL (2025-07-02 04:23:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.310502679s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.343931922s FAIL (2025-07-02 04:23:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== WWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.483583245 (211h2m10.366996878s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.486463918 (211h2m10.369877537s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487276164 (211h2m10.370689782s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.487931464 (211h2m10.371345085s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.488647054 (211h2m10.372060679s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.489381854 (211h2m10.372795479s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.491357802 (211h2m10.374771421s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.493286980 (211h2m10.376700599s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.494990033 (211h2m10.378403645s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.496640219 (211h2m10.380053839s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.497854847 (211h2m10.381268462s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.499240297 (211h2m10.38265392s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.503423699 (211h2m10.386837317s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.504688840 (211h2m10.38810246s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:10.507716926 (211h2m10.391130538s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Uploading piece... Jul 2 04:13:11.091150421 (211h2m10.974564038s) [upload=168801]: Next returned nil segment Jul 2 04:13:11.091210721 (211h2m10.974624351s) [upload=168801]: Waiting for error group managing segments... Jul 2 04:13:11.224127987 (211h2m11.107541604s) [noise=true , address=104.36.82.2:4731 , piece_id=ENXPHEJM6AA4ZVPAJ4LBDSDPVPNFXSOW4YEFQV7I67SO66OZEY3Q, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.227509915 (211h2m11.110923534s) [noise=true , address=104.36.82.10:4079 , piece_id=VNUZHNQE7XI4JXKRPYX6NDWKLGS6KW6ANRG65HCY2NWK7XWHOJZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.230251559 (211h2m11.113665175s) [noise=true , address=104.36.82.3:4767 , piece_id=DATEOSYAE7JO4RKN6WZYPPAYWDZDBSQXQSVT7IDV3Y4HLEI6SQDQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.232589626 (211h2m11.116003245s) [noise=true , address=104.36.82.6:4876 , piece_id=H2WWPUQN6X6YCQQK7HICBODSZZBAVGFVCS4AJK6JRFQBBKBJJTZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.234638228 (211h2m11.118051846s) [noise=true , address=104.36.82.8:4972 , piece_id=FUWF5Y3FLQLS4F4L2WTJUEZUXZO5ONHDWWHBKVOCR6GYAOA2JP4A, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.236463794 (211h2m11.119877413s) [noise=true , address=104.36.82.7:4911 , piece_id=5MGEOAA5NTGNZOWKW7MQWQ2YFFXCC5IIRP5OHN3ELYNUPLBQXOIQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.258669850 (211h2m11.142083468s) [noise=true , address=104.36.82.11:4113 , piece_id=RRW6N7XQQB3JON75JIBLGHH56NL6VFXN5GUBHGRPQFLXOTITY4ZQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:11.263325751 (211h2m11.146739368s) [noise=true , address=104.36.82.13:4185 , piece_id=GXRVOOJAASFLQ7EYBQZ5EIZFC33CPGG4CWUMIFNYYP6CA53W75YA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: <nil> Jul 2 04:13:40.094816384 (211h2m39.978230007s) [noise=true , address=45.91.116.10:4083 , piece_id=Z4TOZLOGSQRLL6HIBG3AEJZK356VKNCDSETE27RE46JQIS5RYRIA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59798->45.91.116.10:4083: use of closed network connection Jul 2 04:13:40.094892672 (211h2m39.978306289s) [noise=true , address=45.91.116.7:4010 , piece_id=DHCHV263SFC6C7JLZ5YDZYP6PRLC2MQDUM4NBKIAQGYQC53O66HQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44758->45.91.116.7:4010: use of closed network connection Jul 2 04:13:40.094960211 (211h2m39.978373836s) [noise=true , address=77.90.31.11:4553 , piece_id=MT7HUX3CPMXH5FLWFVI5GGOKITDJ2NJFYWJCBTRLVKLPVHAVBRXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: read tcp 139.59.144.22:45046->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095013325 (211h2m39.978426942s) [noise=true , address=77.90.31.13:4627 , piece_id=TZN454N3WCEYETLKLQDSTHTY6SG7XM3NEXEG7CGZDFJZSTQHE7WQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 139.59.144.22:36200->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095022161 (211h2m39.978435781s) [noise=true , address=45.91.116.6:4974 , piece_id=NNRSU4RIQ5ICEF7XUIPSGSRNR26LHDK4QT6FPI3K6RU4RVQTHYXQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57574->45.91.116.6:4974: use of closed network connection Jul 2 04:13:40.095064847 (211h2m39.97847846s) [noise=true , address=45.91.116.9:4262 , piece_id=C6M2QO6CZQ53WMTDT5FGJPMPV6BILK5EV3YC4NZ6BVGUYTL3D4IA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47392->45.91.116.9:4262: use of closed network connection Jul 2 04:13:40.095114736 (211h2m39.978528352s) [noise=true , address=45.91.116.9:4261 , piece_id=MAXW6ORMRUEAB3XPSYXW23EIV3CI5KVKHMX4L6PQSKKPCMG4Y4ZA, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35362->45.91.116.9:4261: use of closed network connection Jul 2 04:13:40.095126048 (211h2m39.978539665s) [noise=true , address=77.90.31.19:4841 , piece_id=5OPMBXHPYGVLCDKDQCZ6Y374BBCO7ZPAXK3A5GCYMHJ2XTHGNJWQ, seg_pos={0 0}, upload=168801]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:38726->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:13:40.095157559 (211h2m39.978571186s) [seg_pos={0 0}, upload=168801]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 2 04:13:40.208880963 (211h2m40.092294583s) [upload=168801]: Done uploading segments... Jul 2 04:13:40.208909447 (211h2m40.092323073s) [upload=168801]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.343963679s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)