Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.851809408s FAIL (2025-10-21 21:29:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.851838155s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.618205353s FAIL (2025-10-21 21:29:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.618284739s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.32998449s FAIL (2025-10-21 21:29:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 79h55m56.299224296s) [seg_pos={0 0}, upload=598259]: Begin upload segment... Oct 21 21:26:08.495884845 (679h55m56.299349445s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.496263329 (679h55m56.299727932s) [seg_pos={0 0}, upload=598259]: Done begin upload segment. Oct 21 21:26:08.496307238 (679h55m56.299771843s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497412950 (679h55m56.300877554s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497681783 (679h55m56.301146387s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497966420 (679h55m56.301431033s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498322244 (679h55m56.301786847s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498446002 (679h55m56.30191061s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498944412 (679h55m56.302409014s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.499504528 (679h55m56.302969129s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.500710908 (679h55m56.304175504s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.501945299 (679h55m56.305409901s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.503349707 (679h55m56.306814307s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.505306389 (679h55m56.308770991s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.507500478 (679h55m56.310965083s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.510112475 (679h55m56.313577077s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.515434693 (679h55m56.318899295s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:09.111799758 (679h55m56.915264349s) [upload=598259]: Next returned nil segment Oct 21 21:26:09.111825994 (679h55m56.915290595s) [upload=598259]: Waiting for error group managing segments... Oct 21 21:26:09.250630272 (679h55m57.054094858s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.250861642 (679h55m57.054326226s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.251085636 (679h55m57.054550219s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.252043316 (679h55m57.055507896s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.254746616 (679h55m57.058211209s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.273098197 (679h55m57.076562793s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:10.629898811 (679h55m58.433363394s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:16.420197867 (679h56m4.223662448s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:27.762835686 (679h56m15.566300265s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:38.083181867 (679h56m25.88664645s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection Oct 21 21:26:38.083254545 (679h56m25.886719125s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: expected piece hash; context deadline exceeded; EOF Oct 21 21:26:38.083274067 (679h56m25.886738651s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection Oct 21 21:26:38.083339462 (679h56m25.886804047s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: read tcp 139.59.144.22:49426->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 21 21:26:38.083379127 (679h56m25.88684371s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection Oct 21 21:26:38.083453729 (679h56m25.886918325s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection Oct 21 21:26:38.083519269 (679h56m25.886983854s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection Oct 21 21:26:38.083705711 (679h56m25.887170399s) [seg_pos={0 0}, upload=598259]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 21 21:26:38.199686825 (679h56m26.003151424s) [upload=598259]: Done uploading segments... Oct 21 21:26:38.199773196 (679h56m26.0032378s) [upload=598259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 2.330017097s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.517601411s FAIL (2025-10-21 21:28:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.517634532s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.332558213s FAIL (2025-10-21 21:28:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 79h55m56.299224296s) [seg_pos={0 0}, upload=598259]: Begin upload segment... Oct 21 21:26:08.495884845 (679h55m56.299349445s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.496263329 (679h55m56.299727932s) [seg_pos={0 0}, upload=598259]: Done begin upload segment. Oct 21 21:26:08.496307238 (679h55m56.299771843s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497412950 (679h55m56.300877554s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497681783 (679h55m56.301146387s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497966420 (679h55m56.301431033s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498322244 (679h55m56.301786847s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498446002 (679h55m56.30191061s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498944412 (679h55m56.302409014s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.499504528 (679h55m56.302969129s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.500710908 (679h55m56.304175504s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.501945299 (679h55m56.305409901s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.503349707 (679h55m56.306814307s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.505306389 (679h55m56.308770991s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.507500478 (679h55m56.310965083s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.510112475 (679h55m56.313577077s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.515434693 (679h55m56.318899295s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:09.111799758 (679h55m56.915264349s) [upload=598259]: Next returned nil segment Oct 21 21:26:09.111825994 (679h55m56.915290595s) [upload=598259]: Waiting for error group managing segments... Oct 21 21:26:09.250630272 (679h55m57.054094858s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.250861642 (679h55m57.054326226s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.251085636 (679h55m57.054550219s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.252043316 (679h55m57.055507896s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.254746616 (679h55m57.058211209s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.273098197 (679h55m57.076562793s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:10.629898811 (679h55m58.433363394s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:16.420197867 (679h56m4.223662448s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:27.762835686 (679h56m15.566300265s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:38.083181867 (679h56m25.88664645s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection Oct 21 21:26:38.083254545 (679h56m25.886719125s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: expected piece hash; context deadline exceeded; EOF Oct 21 21:26:38.083274067 (679h56m25.886738651s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection Oct 21 21:26:38.083339462 (679h56m25.886804047s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: read tcp 139.59.144.22:49426->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 21 21:26:38.083379127 (679h56m25.88684371s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection Oct 21 21:26:38.083453729 (679h56m25.886918325s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection Oct 21 21:26:38.083519269 (679h56m25.886983854s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection Oct 21 21:26:38.083705711 (679h56m25.887170399s) [seg_pos={0 0}, upload=598259]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 21 21:26:38.199686825 (679h56m26.003151424s) [upload=598259]: Done uploading segments... Oct 21 21:26:38.199773196 (679h56m26.0032378s) [upload=598259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 2.332590022s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.394240223s FAIL (2025-10-21 21:27:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 79h55m56.299224296s) [seg_pos={0 0}, upload=598259]: Begin upload segment... Oct 21 21:26:08.495884845 (679h55m56.299349445s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.496263329 (679h55m56.299727932s) [seg_pos={0 0}, upload=598259]: Done begin upload segment. Oct 21 21:26:08.496307238 (679h55m56.299771843s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497412950 (679h55m56.300877554s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497681783 (679h55m56.301146387s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497966420 (679h55m56.301431033s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498322244 (679h55m56.301786847s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498446002 (679h55m56.30191061s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498944412 (679h55m56.302409014s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.499504528 (679h55m56.302969129s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.500710908 (679h55m56.304175504s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.501945299 (679h55m56.305409901s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.503349707 (679h55m56.306814307s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.505306389 (679h55m56.308770991s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.507500478 (679h55m56.310965083s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.510112475 (679h55m56.313577077s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.515434693 (679h55m56.318899295s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:09.111799758 (679h55m56.915264349s) [upload=598259]: Next returned nil segment Oct 21 21:26:09.111825994 (679h55m56.915290595s) [upload=598259]: Waiting for error group managing segments... Oct 21 21:26:09.250630272 (679h55m57.054094858s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.250861642 (679h55m57.054326226s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.251085636 (679h55m57.054550219s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.252043316 (679h55m57.055507896s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.254746616 (679h55m57.058211209s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.273098197 (679h55m57.076562793s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:10.629898811 (679h55m58.433363394s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:16.420197867 (679h56m4.223662448s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:27.762835686 (679h56m15.566300265s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:38.083181867 (679h56m25.88664645s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection Oct 21 21:26:38.083254545 (679h56m25.886719125s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: expected piece hash; context deadline exceeded; EOF Oct 21 21:26:38.083274067 (679h56m25.886738651s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection Oct 21 21:26:38.083339462 (679h56m25.886804047s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: read tcp 139.59.144.22:49426->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 21 21:26:38.083379127 (679h56m25.88684371s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection Oct 21 21:26:38.083453729 (679h56m25.886918325s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection Oct 21 21:26:38.083519269 (679h56m25.886983854s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection Oct 21 21:26:38.083705711 (679h56m25.887170399s) [seg_pos={0 0}, upload=598259]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 21 21:26:38.199686825 (679h56m26.003151424s) [upload=598259]: Done uploading segments... Oct 21 21:26:38.199773196 (679h56m26.0032378s) [upload=598259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 2.394285741s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.680751281s FAIL (2025-10-21 21:27:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.680823671s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.449940379s FAIL (2025-10-21 21:26:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 79h55m56.299224296s) [seg_pos={0 0}, upload=598259]: Begin upload segment... Oct 21 21:26:08.495884845 (679h55m56.299349445s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.496263329 (679h55m56.299727932s) [seg_pos={0 0}, upload=598259]: Done begin upload segment. Oct 21 21:26:08.496307238 (679h55m56.299771843s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497412950 (679h55m56.300877554s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497681783 (679h55m56.301146387s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497966420 (679h55m56.301431033s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498322244 (679h55m56.301786847s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498446002 (679h55m56.30191061s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498944412 (679h55m56.302409014s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.499504528 (679h55m56.302969129s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.500710908 (679h55m56.304175504s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.501945299 (679h55m56.305409901s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.503349707 (679h55m56.306814307s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.505306389 (679h55m56.308770991s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.507500478 (679h55m56.310965083s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.510112475 (679h55m56.313577077s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.515434693 (679h55m56.318899295s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:09.111799758 (679h55m56.915264349s) [upload=598259]: Next returned nil segment Oct 21 21:26:09.111825994 (679h55m56.915290595s) [upload=598259]: Waiting for error group managing segments... Oct 21 21:26:09.250630272 (679h55m57.054094858s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.250861642 (679h55m57.054326226s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.251085636 (679h55m57.054550219s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.252043316 (679h55m57.055507896s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.254746616 (679h55m57.058211209s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.273098197 (679h55m57.076562793s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:10.629898811 (679h55m58.433363394s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:16.420197867 (679h56m4.223662448s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:27.762835686 (679h56m15.566300265s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:38.083181867 (679h56m25.88664645s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection Oct 21 21:26:38.083254545 (679h56m25.886719125s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: expected piece hash; context deadline exceeded; EOF Oct 21 21:26:38.083274067 (679h56m25.886738651s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection Oct 21 21:26:38.083339462 (679h56m25.886804047s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: read tcp 139.59.144.22:49426->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 21 21:26:38.083379127 (679h56m25.88684371s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection Oct 21 21:26:38.083453729 (679h56m25.886918325s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection Oct 21 21:26:38.083519269 (679h56m25.886983854s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection Oct 21 21:26:38.083705711 (679h56m25.887170399s) [seg_pos={0 0}, upload=598259]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 21 21:26:38.199686825 (679h56m26.003151424s) [upload=598259]: Done uploading segments... Oct 21 21:26:38.199773196 (679h56m26.0032378s) [upload=598259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 2.449975966s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.529518951s FAIL (2025-10-21 21:26:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.529549895s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.11921735s FAIL (2025-10-21 21:26:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 79h55m56.299224296s) [seg_pos={0 0}, upload=598259]: Begin upload segment... Oct 21 21:26:08.495884845 (679h55m56.299349445s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.496263329 (679h55m56.299727932s) [seg_pos={0 0}, upload=598259]: Done begin upload segment. Oct 21 21:26:08.496307238 (679h55m56.299771843s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497412950 (679h55m56.300877554s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497681783 (679h55m56.301146387s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.497966420 (679h55m56.301431033s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498322244 (679h55m56.301786847s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498446002 (679h55m56.30191061s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.498944412 (679h55m56.302409014s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.499504528 (679h55m56.302969129s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.500710908 (679h55m56.304175504s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.501945299 (679h55m56.305409901s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.503349707 (679h55m56.306814307s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.505306389 (679h55m56.308770991s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.507500478 (679h55m56.310965083s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.510112475 (679h55m56.313577077s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:08.515434693 (679h55m56.318899295s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Uploading piece... Oct 21 21:26:09.111799758 (679h55m56.915264349s) [upload=598259]: Next returned nil segment Oct 21 21:26:09.111825994 (679h55m56.915290595s) [upload=598259]: Waiting for error group managing segments... Oct 21 21:26:09.250630272 (679h55m57.054094858s) [noise=true , address=145.79.227.13:4804 , piece_id=EX4QYQWMJ5JL6Z4VGJZ7Q6JQQ6MYV3A6LWXVWVIV4AN6DWAVKMBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.250861642 (679h55m57.054326226s) [noise=true , address=145.79.227.17:4972 , piece_id=EH2QLQ2QFSNWEAZKHSQKCF3MZM4H5MITH762QQWND5P2IZKGLJRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.251085636 (679h55m57.054550219s) [noise=true , address=145.79.227.11:4730 , piece_id=QXCK5XS5VR33K2PXWFHZQEPZZ5L7U4USQJAT5KDRTSHNOUZU4NWQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.252043316 (679h55m57.055507896s) [noise=true , address=145.79.227.8:4329 , piece_id=75ANEH4G7RJ6EZPAOF2E2TUYLT5M6PFWFFHP6WGXIMDGZXBLMH3A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.254746616 (679h55m57.058211209s) [noise=true , address=145.79.227.16:4912 , piece_id=2HOPDVQNK6YO5ZKLTOIYKZLJEUKOXJJAAJE2EBSVOEQPW5IVWTQQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:09.273098197 (679h55m57.076562793s) [noise=true , address=145.79.227.6:4258 , piece_id=26W7SRPXZQS5DQGHV5SUJGCCG4FF4NB6RGI5SEFKFOWLST4HTJVQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:10.629898811 (679h55m58.433363394s) [noise=true , address=77.90.31.18:4807 , piece_id=E3NNAB5A5LMAB7LOUK7DMUZTGOLZ5E4QFTWAUTJKINKEFPBRWP6A, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:16.420197867 (679h56m4.223662448s) [noise=true , address=77.90.31.13:4628 , piece_id=HMLMTQAJEZ54JBEUTONZYF6OCF2WPDR7QFPDB7IAUFEPZZZLIPRQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:27.762835686 (679h56m15.566300265s) [noise=true , address=45.91.116.4:4940 , piece_id=PXNWSSGMV6TXVG6U6HIULKGCGUZCYSDZKYL2AK45IGJPVYRCOCBQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: <nil> Oct 21 21:26:38.083181867 (679h56m25.88664645s) [noise=true , address=45.91.116.4:4937 , piece_id=YA7STPE6YXXBWD7HENDC6LE2KXQLO3V577NDDN3GZMFRLSVSA5UQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47400->45.91.116.4:4937: use of closed network connection Oct 21 21:26:38.083254545 (679h56m25.886719125s) [noise=true , address=77.90.31.14:4662 , piece_id=BF6DJSTH4UVD5Z3VDKWCBRGPQS6AW2FFFKGT4WECLSUJRHBLTOXA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: expected piece hash; context deadline exceeded; EOF Oct 21 21:26:38.083274067 (679h56m25.886738651s) [noise=true , address=77.90.31.15:4697 , piece_id=3QIPJV6JASUPK3WDFEXXP2MWPETPFEVHC4PSFZO6PGNQEPTJ42YA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49604->77.90.31.15:4697: use of closed network connection Oct 21 21:26:38.083339462 (679h56m25.886804047s) [noise=true , address=77.90.31.16:4734 , piece_id=KAZWNLJG2UJPMRMSZVORYBPEOU3KBMJ6H7BFJS7SBTIS6YLBBMMQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: read tcp 139.59.144.22:49426->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 21 21:26:38.083379127 (679h56m25.88684371s) [noise=true , address=77.90.31.12:4592 , piece_id=52HQLMW2E54Z7SMGN2JQVNC2YDE6NLHLUBFID72MWF7NCFDBGFUA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39984->77.90.31.12:4592: use of closed network connection Oct 21 21:26:38.083453729 (679h56m25.886918325s) [noise=true , address=77.90.31.11:4553 , piece_id=T2PQTDOOPWD75R3SR5MW6YIVDJQMYOETLOWMY2IPDBZEQNLM4ZTQ, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59090->77.90.31.11:4553: use of closed network connection Oct 21 21:26:38.083519269 (679h56m25.886983854s) [noise=true , address=77.90.31.10:4517 , piece_id=T2OQ4ZUGGGHRZDQRMKTNEFNF4BOEL5777DURFRUVIJOU5CHL3ACA, seg_pos={0 0}, upload=598259]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37548->77.90.31.10:4517: use of closed network connection Oct 21 21:26:38.083705711 (679h56m25.887170399s) [seg_pos={0 0}, upload=598259]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 21 21:26:38.199686825 (679h56m26.003151424s) [upload=598259]: Done uploading segments... Oct 21 21:26:38.199773196 (679h56m26.0032378s) [upload=598259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.119278046s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.907857838s FAIL (2025-10-21 21:26:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.907884304s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001195101s FAIL (2025-10-21 21:26:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001226031s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.681848134s FAIL (2025-10-21 15:27:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.681937205s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.6495081s FAIL (2025-10-21 15:26:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.649830628s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.801798741s FAIL (2025-10-21 15:26:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.801835015s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.737094788s FAIL (2025-10-21 15:25:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.737313156s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.552045605s FAIL (2025-10-21 15:24:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.552861694s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.812719604s FAIL (2025-10-21 15:24:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.812749598s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.818212196s FAIL (2025-10-21 15:22:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.818240809s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.552356689s FAIL (2025-10-21 15:22:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.552383879s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.536181217s FAIL (2025-10-21 15:21:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.536206924s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.707691148s FAIL (2025-10-21 15:20:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.707719742s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.742446621s FAIL (2025-10-21 15:19:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.742475513s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.507095683s FAIL (2025-10-21 15:19:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.507121553s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.657123885s FAIL (2025-10-21 15:18:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.657216301s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.844150471s FAIL (2025-10-21 15:18:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.844170925s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.574946337s FAIL (2025-10-21 15:17:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.574975504s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.675738467s FAIL (2025-10-21 15:16:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.67580339s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.691156271s FAIL (2025-10-21 15:15:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.691207906s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.714532361s FAIL (2025-10-21 15:15:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.714583275s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.563443893s FAIL (2025-10-21 15:14:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.563457935s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.685933961s FAIL (2025-10-21 15:13:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.686056119s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.787671764s FAIL (2025-10-21 15:12:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.788020946s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.837395158s FAIL (2025-10-21 15:11:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.837416365s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.652326977s FAIL (2025-10-21 15:11:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.652358458s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.704010202s FAIL (2025-10-21 15:10:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.704050743s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.749523458s FAIL (2025-10-21 15:09:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.749553023s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.771902845s FAIL (2025-10-21 15:08:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.771932693s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.809262207s FAIL (2025-10-21 15:08:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.809290849s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.570214043s FAIL (2025-10-21 15:07:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.570306819s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.824813792s FAIL (2025-10-21 15:06:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.824846714s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.927906445s FAIL (2025-10-21 15:05:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.927933144s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.677155153s FAIL (2025-10-21 15:05:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.677243619s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.674181464s FAIL (2025-10-21 15:04:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.674249515s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.812938189s FAIL (2025-10-21 15:03:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.812956548s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.556698551s FAIL (2025-10-21 15:02:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.556727796s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.830863304s FAIL (2025-10-21 15:02:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.830894905s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.559455291s FAIL (2025-10-21 15:01:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.559493714s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.870938978s FAIL (2025-10-21 15:00:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.871004835s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.847466778s FAIL (2025-10-21 15:00:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.847494282s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)