Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.824944291s FAIL (2025-09-18 06:47:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.824970316s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.532196296s FAIL (2025-09-18 06:47:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.532234328s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.801058732s FAIL (2025-09-18 06:47:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.801092663s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.894492709s FAIL (2025-09-18 06:47:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.894540584s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.666627043s FAIL (2025-09-18 06:47:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.666666342s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.804577311s FAIL (2025-09-18 06:47:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.804623069s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.521573177s FAIL (2025-09-18 06:46:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.521679808s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.436546192s FAIL (2025-09-18 06:46:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.43658977s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.91466641s FAIL (2025-09-18 06:46:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.914699748s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 3.297420202s FAIL (2025-09-18 06:46:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.297457617s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.994698787s FAIL (2025-09-18 06:46:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.994747571s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.634481301s FAIL (2025-09-18 06:45:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.634540945s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.509819595s FAIL (2025-09-18 06:45:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.509877465s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 3.375762699s FAIL (2025-09-18 06:45:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.37584473s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.775812885s FAIL (2025-09-18 06:45:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.775920864s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.682350955s FAIL (2025-09-18 06:45:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.68238159s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.892198226s FAIL (2025-09-18 06:44:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.892239441s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.794314802s FAIL (2025-09-18 06:44:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.794342425s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 3.34752349s FAIL (2025-09-18 06:44:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.347555395s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.957643898s FAIL (2025-09-18 06:44:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.957666229s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.575049s FAIL (2025-09-18 06:43:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.57510149s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.926258141s FAIL (2025-09-18 06:43:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.926348306s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.913713072s FAIL (2025-09-18 06:43:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.913739906s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 3.080274255s FAIL (2025-09-18 06:43:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.080311892s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.43326331s FAIL (2025-09-18 06:42:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.433297625s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.666648292s FAIL (2025-09-18 06:42:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.666712118s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.516681166s FAIL (2025-09-18 06:42:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.516719098s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.82764463s FAIL (2025-09-18 06:42:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.827669055s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.944952882s FAIL (2025-09-18 06:42:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.944992653s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.463848598s FAIL (2025-09-18 06:41:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.463900743s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.889425405s FAIL (2025-09-18 06:41:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.889472226s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.688813548s FAIL (2025-09-18 06:41:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.688863274s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.672990353s FAIL (2025-09-18 06:40:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.6730198s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.574280934s FAIL (2025-09-18 06:40:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.574313815s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.90188997s FAIL (2025-09-18 06:40:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.901916918s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.53614663s FAIL (2025-09-18 06:40:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.536252902s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.503332444s FAIL (2025-09-18 06:40:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.503388722s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.977244251s FAIL (2025-09-18 06:40:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.97729795s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.918920767s FAIL (2025-09-18 06:39:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.919799359s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.636871058s FAIL (2025-09-18 06:39:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.636904877s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.847900364s FAIL (2025-09-18 06:39:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.847933388s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.90356305s FAIL (2025-09-18 06:38:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.903582989s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.497394069s FAIL (2025-09-18 06:38:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.497427165s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.784869717s FAIL (2025-09-18 06:38:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.784944753s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 3.118736975s FAIL (2025-09-18 06:38:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.118776057s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.549187846s FAIL (2025-09-18 06:38:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.549224655s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.804276341s FAIL (2025-09-18 06:37:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.804396323s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.814847571s FAIL (2025-09-18 06:37:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.814883906s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.453059156s FAIL (2025-09-18 06:36:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606164283 (472h12m51.098596735s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.606697593 (472h12m51.099130037s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608051611 (472h12m51.100484056s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.608678493 (472h12m51.101110944s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.609893324 (472h12m51.102325779s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.610954207 (472h12m51.103386656s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611458361 (472h12m51.103890813s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.611966832 (472h12m51.104399283s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.615074539 (472h12m51.107506985s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.617371261 (472h12m51.109803715s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.618213880 (472h12m51.110646334s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:30.619133336 (472h12m51.111565791s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Uploading piece... Sep 18 06:20:31.285536041 (472h12m51.77796849s) [upload=415363]: Next returned nil segment Sep 18 06:20:31.285571077 (472h12m51.778003528s) [upload=415363]: Waiting for error group managing segments... Sep 18 06:20:31.397318156 (472h12m51.889750585s) [noise=true , address=145.79.227.3:4150 , piece_id=6EBIJLTHIJKVODLIBPRYY2ZQPW6NJETKPR4JTZBXYC4OCTIKNF4Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.409603457 (472h12m51.902035902s) [noise=true , address=145.79.227.13:4802 , piece_id=XDUCHMCSIFXZUN7HIZCOUTBH3WGAUOYV3NRI7JNXA4FHDFQAYTXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:20:31.412562303 (472h12m51.904994735s) [noise=true , address=145.79.227.19:4077 , piece_id=DAGFGYSY6GRWVDGDQHH2XJXUSINUWRNPCQYZSBEBDTWNXDZ3DIGA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: <nil> Sep 18 06:21:00.171009301 (472h13m20.663441758s) [noise=true , address=45.91.116.12:4226 , piece_id=7NKKWSTZ3WTW4NA7VTRWSSPSNBLXW3NJBOCEDT34NKYSGVD7UFCA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 139.59.144.22:54302->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.171668056 (472h13m20.664100511s) [noise=true , address=45.91.116.10:4081 , piece_id=RHWZE4VNRGE4GRRKSUE2JZGLK2GSC6VJI5KAUVCSV2L3OZBDQLXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: read tcp 139.59.144.22:37718->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172033515 (472h13m20.664465965s) [noise=true , address=77.90.31.16:4734 , piece_id=HGNBJ7J3C5S5PIW4IEJGM6CYNZVJNI7XVHV3CR7GWE5QGUR3EYEA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172061093 (472h13m20.664493549s) [noise=true , address=45.91.116.5:4297 , piece_id=4XPFFRMWOX6NW2ZB6AVJ2NZH2MPSQLW67SAMJFT7BCYOEQKL4SOA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172531910 (472h13m20.664964367s) [noise=true , address=45.91.116.14:4191 , piece_id=AB4SNVFELNE6JQPTWQ7X5NQXDIMUJJXSJZDL4RRR7OY6XXPOR4CA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172634427 (472h13m20.665066857s) [noise=true , address=45.91.116.7:4010 , piece_id=4CKR6F2YD2OAGWVRRAWMMQ7EQUH6NUWOQVYQHGCT4EYMFWGXHHXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: write tcp 139.59.144.22:37268->45.91.116.7:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172651500 (472h13m20.66508395s) [noise=true , address=45.91.116.13:4155 , piece_id=HN7PMJACV7KXH7PSOGIF55T7KV6AHKVBLTDFLFUKM7WTFBEW7N4A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:45276->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172708335 (472h13m20.665140789s) [noise=true , address=77.90.31.14:4662 , piece_id=6HOFUMZOGMABSV2UKSU4B3YUQCW33FIFB2Y5AKMXQXRT3SNMDDLA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 139.59.144.22:59692->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172770932 (472h13m20.665203365s) [noise=true , address=45.91.116.4:4939 , piece_id=IQCTRATIFNKF7YEGNYP52PUXCMT2N23AFVSX37BBW42IK6MXTBXA, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:43042->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172832116 (472h13m20.665264567s) [noise=true , address=45.91.116.6:4973 , piece_id=R2H5RBFIX4BUUKWJGMPQPEM5EDQ3OLL6MFVTXFUF7RQTN57BVD7A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:49606->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172871254 (472h13m20.665303689s) [noise=true , address=45.91.116.11:4118 , piece_id=2V6WZWKGO6SNLB2UR5Q5TP5VKBPB3JBJ2HUMXEAAWICBN472P47A, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:55146->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172885844 (472h13m20.665318284s) [noise=true , address=45.91.116.13:4154 , piece_id=3W2YWDE54STQE25JSBSAFS2XRFELZKHSZXVQEEHAWJ6LNJHVJGFQ, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 139.59.144.22:59448->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172898443 (472h13m20.665330883s) [noise=true , address=45.91.116.11:4119 , piece_id=2BUVZ3ZMQCR47NJZFHA7DF53PWKHKLHGTSHBTRSR5EZHWKXZX67Q, seg_pos={0 0}, upload=415363]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 139.59.144.22:55382->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:00.172972913 (472h13m20.665405371s) [seg_pos={0 0}, upload=415363]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 18 06:21:00.285796348 (472h13m20.778228783s) [upload=415363]: Done uploading segments... Sep 18 06:21:00.285852252 (472h13m20.778284705s) [upload=415363]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 2.453091189s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.748924606s FAIL (2025-09-18 06:36:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.748951916s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)